5 open roles
Junior Databricks Engineer
Job description
Junior Databricks Engineer
Our Company
N2IA Technologies is a consulting company specializing in acquisition/contracting support, cost/FinOps, and technology optimization for federal clients. We deliver tailored strategies, robust software solutions, and streamlined operations to help organizations achieve their goals. At N2IA, we are committed to developing innovative financial and compliance-based solutions that address evolving business and regulatory needs. If you are passionate about accounting, financial accuracy, and supporting government programs, N2IA is the place for you.
Overview
N2IA is seeking a Junior Databricks Data Engineer to support the development, refinement, and maintenance of core data pipelines on the Databricks Lakehouse Platform that enable enterprise AI, analytics, and mission systems. This role is essential for making data accessible, reliable, and usable across the agency. You will work with senior engineers, cloud engineers, data architects, and AI developers to ensure data is clean, connected, secure, and optimized for advanced analytics and AI/ML workflows.
Key Responsibilities:
- Support the development and maintenance of scalable data pipelines and ETL/ELT workflows on Databricks using Delta Lake, Delta Live Tables (DLT), and the medallion (bronze/silver/gold) architecture across cloud and on-prem systems.
- Develop and maintain workflows using Databricks Workflows/Jobs with guidance from senior engineers.
- Implement data quality checks, validation, lineage tracking, and metadata management using Unity Catalog and Lakehouse Monitoring / DLT expectations.
- Collaborate with other teams to ensure datasets meet requirements and are discoverable through Unity Catalog.
- Support automated ingestion and transformation processes using Databricks-native patterns such as Auto Loader, Structured Streaming, and the COPY INTO command.
- Assist with API development, data mapping, data modeling, and domain-driven data structures within the Lakehouse.
- Troubleshoot pipeline issues and assist with optimizing Spark jobs and clusters for performance and cost.
Required Qualifications:
- 2–5 years of relevant experience in data engineering or related technical work.
- Hands-on experience developing and maintaining data pipelines on Databricks.
- Working proficiency with Apache Spark (PySpark and Spark SQL), Delta Lake, and the Databricks Lakehouse Platform.
- Hands-on experience with Databricks on Azure and/or AWS (e.g., Azure Databricks, Azure Data Factory, AWS Glue, or similar orchestration tooling).
- Familiarity with Unity Catalog for data governance, access control, and lineage.
- Experience integrating structured and unstructured data sources.
- Knowledge of SQL, schema design, data modeling, and cloud-based storage patterns (e.g., Delta tables, cloud object storage).
- Experience supporting federal government customers.
- Active Secret clearance or higher.
- Security+ certification or an approved waiver, if applicable.
- Ability to travel approximately 10–20%.
Preferred Qualifications:
- Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional).
- Exposure to AI/ML pipelines, vectorization, or embedding generation, ideally using MLflow, Databricks Mosaic AI, Model Serving, or Vector Search.
- Experience with Delta Live Tables and streaming pipelines (Structured Streaming / Auto Loader).
- AWS experience.
- Experience with data governance, access controls, or sensitive data protection (Unity Catalog, row/column-level security).
- Exposure to DevOps/CI-CD patterns for data workflows (e.g., Databricks Asset Bundles, Repos, Terraform).
- MuleSoft implementation experience.
- Experience supporting DoD customers.
N2IA is committed to fostering a diverse and inclusive work environment. We are an Equal Employment Opportunity Employer and encourage applications from all qualified individuals, regardless of gender, race, ethnicity, sexual orientation, disability, or veteran status.
Description copied from N2IA Technologies's careers page. Read the full posting before you apply.
More jobs at N2IA Technologies
Senior Databricks Engineer
N2IA Technologies· Washington, United StatesSenior UX Designer (Design Systems & Figma)
N2IA Technologies· Washington, United StatesOperations Research / Systems Analyst (ORSA) - Modeling & Simulation Focus
N2IA Technologies· Washington, United StatesJira Administrator
N2IA Technologies· Washington, United States
More jobs in Washington
Senior High Voltage & Electrical Subject Matter Expert
Capital Power· Washington, DC· $120k – $160kSolutions Architect
Imagineeer· Washington, District of Columbia, United States· $150k – $160kYmca Kipp DC After School Program Leader
YMCA of Metropolitan Washington· Washington, United States· $37k – $44kTemporary Research Consultant - Ethics and Professional Review Req# 274
National Association of Social Workers· Washington, District Of Columbia, United States of AmericaConsultant, Real Property Tax
Ryan· Washington, DC· $69k – $86k
