Note: The job is a remote job and is open to candidates in USA. Rackner is a software consultancy focused on building mission-critical systems for the U.S. government. The Data Engineer will design, develop, and maintain cloud-based data ingestion, transformation, integration, and data quality processes primarily within Microsoft Fabric. The role will also support Ed-Fi education data integrations, enterprise system migrations, API synchronization, documentation, and operational transition activities.

Responsibilities

• Develop and maintain data ingestion pipelines, transformation logic, and data quality processes within Microsoft Fabric
• Implement and maintain Bronze, Silver, and Gold medallion architecture layers for assigned data domains
• Extract, transform, and load data from enterprise source systems, including:
• Student information systems
• HR and personnel systems
• Financial systems
• Logistics systems
• IT service management platforms
• Operational databases
• Develop ETL and ELT pipelines that ingest source-system data into the Microsoft Fabric Lakehouse
• Build and maintain data integration pipelines, API connections, and automated synchronization processes
• Develop Ed-Fi REST API integrations supporting education data workstreams
• Implement Aspen-to-Ed-Fi export mappings, descriptor customization, transformation logic, and API-based data synchronization
• Develop non-education data ingestion pipelines supporting HR/DCPDS, finance, logistics, and IT service management domains
• Perform source-system data profiling, mapping, cleansing, and transformation
• Conduct reconciliation testing and validate data completeness, accuracy, and consistency across source and target systems
• Identify, troubleshoot, and resolve data quality, pipeline, and integration issues
• Develop SQL queries, Python or PySpark processing logic, and reusable data transformation components
• Support data population and migration activities across cloud and enterprise data environments
• Produce and maintain technical documentation for data pipelines, interfaces, mappings, transformation logic, and operational processes
• Collaborate with data architects, analysts, governance specialists, application teams, and source-system owners to define and implement data integration requirements
• Support Ed-Fi Data Management Service (DMS) migration planning as the DMS reaches production readiness
• Support knowledge transfer and operational transition activities for implemented pipelines and data services

Skills

• • Experience developing data pipelines, ETL/ELT processes, and data integrations
• • Experience with Microsoft Fabric, Azure Data Factory, or comparable cloud data platforms
• • Strong SQL proficiency, including querying, transformation, validation, and troubleshooting
• • Experience with Python and/or PySpark for data engineering workloads
• • Experience working with structured and semi-structured enterprise data
• • Understanding of cloud-based data lake, lakehouse, or data warehouse architectures
• • Experience with data mapping, data profiling, reconciliation testing, and data quality processes
• • Experience integrating systems through REST APIs or similar application interfaces
• • Ability to document data flows, pipeline configurations, mappings, and technical processes
• • Strong troubleshooting, analytical, and communication skills
• • Active Secret clearance
• • Experience with Microsoft Fabric Lakehouse architecture
• • Experience implementing Bronze, Silver, and Gold medallion data architectures
• • Experience with the Ed-Fi Data Standard, Ed-Fi ODS/API, or Ed-Fi REST APIs
• • Experience performing Aspen-to-Ed-Fi mapping or integrating other student information systems with Ed-Fi
• • Experience with HR/DCPDS, financial, logistics, or IT service management data
• • Experience supporting large-scale cloud data migrations or modernization initiatives
• • Familiarity with data governance, metadata management, lineage, and enterprise data quality practices

Benefits

• Company-supported certifications aligned to current and future program work, including cloud, Kubernetes, DevSecOps, security, AI/ML, project management, and related technical areas
• Clear advancement tracks and future leadership opportunities
• 401(k) with 100% match up to 6%
• Comprehensive medical, dental, vision, life, and disability coverage
• Generous PTO and paid holidays
• Home-office equipment plan and remote work support
• Fitness and wellness reimbursement
• Weekly pay schedule and modern perks, including team events

Company Overview