Big Data Lead

Big Data Lead Remote Advanced english Only México Must-Have Skills Databricks. Azure Data FactorySQLPython. Data engineering and ETL or ELT development. Data pipeline development and performance optimization Nice-to-Have Skills. Exposure to Generative AI solutions and use cases.Experience working on AI or machine-learning-related data projects.

Knowledge of Power BI, including dataset preparation and report integration.Experience with Py. Spark, Delta Lake, or Azure Data Lake Storage.Familiarity with Microsoft Azure cloud services.Understanding of CI/CD processes for data-engineering solutions.Exposure to data preparation for large language models, embeddings, vector databases, or retrieval-augmented generation solutions.