422 open roles
Data Platform Architect
Job description
About Task. Us: Task. Us is a provider of outsourced digital services and next-generation customer experience to fast-growing technology companies, helping its clients represent, protect and grow their brands. Leveraging a cloud-based infrastructure, Task. Us serves clients in the fastest-growing sectors, including social media, e-commerce, gaming, streaming media, food delivery, ride-sharing, Hi.
Tech, Fin. Tech, and Health. Tech. The People First culture at Task. Us has enabled the company to expand its workforce to approximately 60,000 employees globally. Presently, we have a presence in twenty-three locations across twelve countries, which include the Philippines, India, and the United States. It started with one ridiculously good idea to create a different breed of Business Processing Outsourcing (BPO)!
We at Task. Us understand that achieving growth for our partners requires a culture of constant motion, exploring new technologies, being ready to handle any challenge at a moment’s notice, and mastering consistency in an ever-changing world.
What We Offer
At Task. Us, we prioritize our employees' well-being by offering competitive industry salaries and comprehensive benefits packages. Our commitment to a People First culture is reflected in the various departments we have established, including Total Rewards, Wellness, HR, and Diversity. We take pride in our inclusive environment and positive impact on the community.
Moreover, we actively encourage internal mobility and professional growth at all stages of an employee's career within Task. Us. Join our team today and experience firsthand our dedication to supporting People First. Role Overview: We are seeking an Enterprise Data Platform Architect to design and build a next-generation, vendor-agnostic Data Platform from the ground up.
You will own the foundational platform architecture—decoupling compute from storage using Apache Iceberg, designing containerized execution engines on Kubernetes, establishing multi-engine processing (DuckDB, Py. Iceberg, dbt, serverless query engines), and embedding automated governance from Day
- Work Mode : Remote What You Will Own:
- Custom Platform Architecture: Lead design decisions for a decoupled Lakehouse architecture on AWS and Kubernetes, establishing storage layout, partition evolution, and open table formats (Apache Iceberg).
- Multi-Engine Compute Optimization: Match specific workloads to appropriate engines (e.g., DuckDB for in-memory batch processing, Py. Iceberg for atomic writes, serverless engines for query serving) to maximize speed while minimizing cloud spend.
- Framework & Runner Engineering: Define config-driven pipeline patterns and containerized execution runners that automatically handle idempotency, schema evolution, advisory locking, and step-level logging.
- Embedded Governance & Cataloging: Architect automated, zero-trust data governance from Day 1, integrating open-source catalogs (Apache Polaris, Glue) with column-level security, PII discovery, and automated audit trails.
- Data Quality Frameworks: Design multi-layer, config-driven data quality gates that execute inline in-memory and trigger automated pipeline halts before bad data propagates.
- Architectural Decision Records (ADRs): Maintain a version-controlled repository of technical decisions, documenting trade-offs, compute boundaries, and long-term implications. Core Technical Qualifications:
- 8+ Years in Platform Architecture / Infrastructure Engineering: Proven track record of designing and deploying production-grade, open-standard Data Platforms from scratch.
- Open Table Formats & Decoupled Storage: Deep expertise in Apache Iceberg (or Delta Lake), including native Py. Iceberg APIs, ACID transactions on object storage (S3), schema/partition evolution, and metadata management.
- High-Efficiency & Embedded Compute: Hands-on experience with in-process/vectorized engines (DuckDB, Py. Arrow) and matching workload scales to the right compute engine (single-node vs. distributed).
- Kubernetes & Container Orchestration: Experience in Kubernetes (EKS/K8s)—specifically Pods, Deployments, Config. Maps, Secrets, and custom containerized execution runners.
- Advanced Orchestration: Expert-level Apache Airflow skills, specifically designing dynamic, dependency-aware DAGs and managing worker architecture in resource-constrained environments.
- Transformation & Semantic Layers: Deep proficiency with dbt Core (SQL compilation/modeling) paired with external execution engines and semantic YAML layer definitions.
- Open-Source Catalogs & Governance: Experience implementing open catalog specifications (Apache Polaris, Iceberg REST Catalog) and metadata platforms (Open. Metadata, AWS Lake Formation).
- Cloud Infrastructure (AWS): Advanced knowledge of AWS core services (S3, EKS, IAM, EC2, Serverless Query Serving) with strict adherence to storage-compute separation and Fin. Ops spend optimization. Preferred / Bonus Qualifications (Pluses):
- Databricks & Snowflake Experience (Plus): Experience with Databricks (Lakehouse/Unity Catalog) or Snowflake is a plus, particularly in the context of legacy migrations, hybrid query serving, or cross-engine query federation.
- Data. Ops & CI/CD: Hands-on experience establishing automated testing, blue/green deployment patterns for data models, and Git. Ops workflows.
- Executive Communication: Proven track record translating technical debt, compute benchmarks, and architectural roadmaps for executive leadership and non-technical stakeholders. How We Partner To Protect You: Task. Us will neither solicit money from you during your application process nor require any form of payment in order to proceed with your application. Kindly ensure that you are always in communication with only authorized recruiters of Task. Us. DEI: In Task. Us we believe that innovation and higher performance are brought by people from all walks of life. We welcome applicants of different backgrounds, demographics, and circumstances. Inclusive and equitable practices are our responsibility as a business. Task. Us is committed to providing equal access to opportunities. If you need reasonable accommodations in any part of the hiring process, please let us know. We invite you to explore all Task. Us career opportunities and apply through the provided URL https://www.taskus.com/careers/ .
Description copied from TaskUs's careers page. Read the full posting before you apply.
More jobs at TaskUs
Operations Manager
TaskUs· Cali, Valle del Cauca, ColombiaQuality Manager
TaskUs· Cali, Valle del Cauca, ColombiaFacilities Intern (Tecnico)
TaskUs· Cali, Valle del Cauca, ColombiaBilingual Teammate !
TaskUs· Cali, Valle del Cauca, ColombiaCustomer Service Representative - English
TaskUs· Cali, Valle del Cauca, Colombia
Data Platform Architect jobs at other companies
Data Platform Architect
Siemens Healthineers· TAR B· $144k – $198kData Platform Architect
Comply· New York, United States· $115k – $136kData Platform Architect
Parser· Spain, England#SP-UK, Greater LondonData Platform Architect
Bright Vision Technologies· $140k – $180kData Platform Architect
Accenture Federal Services· Suitland, MD· $132k