[Remote] Data Engineer – Intersystems to Cloud Migration (Snowflake/Databricks)

Note: The job is a remote job and is open to candidates in USA. BigRio is a Boston-headquartered, remote-first technology consulting firm specializing in AI/ML, Cloud Transformation, Data Engineering, Healthcare Modernization, and Digital Innovation. They are seeking a talented Data Engineer to support a high-impact healthcare data migration initiative, focusing on building secure, scalable pipelines to migrate large-volume datasets while ensuring compliance with healthcare privacy standards. Responsibilities • Lead end-to-end migration of datasets from InterSystems (Caché/IRIS) to Snowflake and Databricks within BigRio’s cloud modernization framework • Build, optimize, and maintain large-scale ETL pipelines supporting 5M+ records with high performance and reliability • Implement PHI de-identification and masking processes aligned with HIPAA and BigRio security best practices • Develop scalable data processing jobs using Databricks (Spark, PySpark, bolthires Lake) • Integrate data workflows with AWS RDS, Snowflake, and Databricks • Work with BigRio’s architecture and AI engineering teams to support analytics, reporting, and ML/GenAI initiatives • Ensure data quality, monitoring, and validation throughout migration cycles • Maintain documentation of architecture, data lineage, transformation logic, and operational procedures • Collaborate with distributed BigRio and client teams across the U.S. and India Skills • 5+ years as a Data Engineer, with strong cloud engineering experience • Hands-on expertise with InterSystems (Caché/IRIS) — extraction, schema mapping, transformations • Strong experience building solutions with Snowflake and cloud-native data warehousing • Expertise with Databricks, Spark, and PySpark for large-scale processing • Proven ability to build and optimize ETL pipelines handling 5M+ record volumes • Strong understanding of PHI de-identification, HIPAA compliance, and healthcare data workflows • Experience with AWS RDS, SQL, Python, and cloud orchestration tools • Strong foundation in data modeling, performance tuning, and scalable architecture • Excellent communication skills and comfortable working with global remote teams • Experience with HL7, FHIR, CCD, or healthcare data interoperability • Exposure to dbt, Airflow, Step Functions, or similar orchestration tools • Experience in healthcare data modernization or cloud migrations Company Overview • BigRio is a technology consulting firm empowering data to drive innovation and advanced analytics. It was founded in 2013, and is headquartered in Boston, Massachusetts, USA, with a workforce of 11-50 employees. Its website is Company H1B Sponsorship • BigRio has a track record of offering H1B sponsorships, with 1 in 2024. Please note that this does not guarantee sponsorship for this specific role. Apply tot his job