JD7 - Consultant - Talend

Job purpose: Client-facing consultant who leads discovery, solution design, and delivery of data platforms using the Talend ecosystem. Owns end-to-end engineering across ingestion, transformation, modelling, governance, quality, deployment, and operations. Partners with stakeholders to define outcomes, document solutions, estimate work, and ensure reliable, cost-efficient delivery.

Duties and responsibilities

General areas of responsibility relate to:

• Lead/Co-lead requirements workshops; translate business needs into technical user stories and Talend architecture.
• Design secure, scalable, and cost-optimized Talend-based solutions (cloud or hybrid).
• Prepare solution design artifacts (HLD/LLD, data flow diagrams, mapping specs, runbooks).
• Ensure compliance and governance (GDPR, HIPAA, SOC 2 as applicable) and enterprise standards.
• Drive production reliability: monitoring, incident handling, post-mortems, and continuous improvement.
• Mentor junior engineers; uphold documentation quality and delivery discipline Requirements Specific areas of responsibility include but are not limited to:
• Architect and implement parameterized, metadata-driven Talend Jobs and Joblets for batch and incremental ingestion from databases, files, and APIs (components such as tDBInput/tDBOutput, t. File. Input. Delimited, tREST, tJSON, t. Map, t. Join, t. Aggregate. Row, t. Filter. Row).
• Implement CDC (watermark/timestamp, change tables/logs) and SCD Type 1 & Type 2 with surrogate keys, effective/expiry dates, and current-record flags.
• Standardize contexts, repository metadata, naming conventions, and folder structures for maintainability.
• Optimize performance (lookup caches, bulk loaders, parallelization, commit strategies, memory tuning) and design resilient orchestration using On. Subjob. Ok/On. Component. Ok routes and error handling.
• Configure Talend Management Console: environments (dev/test/prod), workspaces, roles/permissions, and single sign-on if applicable.
• Manage Cloud/Remote Engines and Runtimes; schedule tasks, configure parameters, and administer logs/notifications.
• Integrate with Git for version control; implement CI/CD for Talend artifacts via Azure DevOps/GitHub Actions (build/promote/rollback).
• Monitor executions, set up alerts/retries, and maintain deployment lifecycle across environments.
• Curate business glossaries, technical metadata, classifications, and stewardship assignments.
• Register sources/datasets and enable end-to-end lineage (source → transformation → target).
• Apply policies/roles, tagging, approvals; publish catalogue assets for BI and data consumers.
• Keep catalogue documentation in sync with releases, track change history and ownership.
• Profile data for completeness, uniqueness, pattern conformance, and outliers; define DQ rules and thresholds.
• Implement standardization (names/addresses), validation, deduplication (matching/survivorship).
• Embed DQ checks into pipelines (fail/flag routes, exception tables, remediation workflows).
• Publish DQ dashboards and KPIs (accuracy, timeliness, freshness); drive continuous improvement with stakeholders.
• Design star/snowflake dimensional models, conformed dimensions, and fact tables aligned to business KPIs.
• Select storage engines and formats appropriate to target platforms (e.g., Azure SQL, Synapse,
• Snowflake, Databricks Delta), including partitioning/indexing/distribution strategies.
• Produce mapping specs, data dictionaries, and maintain semantic consistency for downstream BI.
• Enforce RBAC across Talend Cloud (TMC); secure secrets via contexts, encrypted stores, or vault integrations.
• Apply encryption in transit/at rest, masking, and row/column-level security in downstream stores.
• Document policies, access reviews, and audit trails; support compliance reporting and data retention.
• Version Talend projects with Git; adopt branching strategies (feature/release/hotfix).
• Automate build/deploy/promote using TMC APIs or pipelines (Azure DevOps/GitHub Actions).
• Parameterize environments via contexts and variables; maintain release notes, rollback, and DR procedures.
• Set up monitoring and alerts for task failures, SLA breaches, and data freshness; analyse logs to perform root cause analysis.
• Optimize runtime costs (engine sizing, scheduling windows, parallelization, caching) and manage lifecycle policies for storage. Other duties:
• Lead solution walkthroughs; articulate trade-offs (Talend vs. native cloud services, batch vs. micro batch, CDC options).
• Build POCs (SCD2, CDC, DQ, Catalogue lineage) to validate approaches and de-risk delivery.
• Create effort estimates, risks, assumptions, and RACI; manage stakeholder expectations and change requests.
• Present progress to business audiences; simplify complex technical topics and capture decisions/actions.
• Develop metrics and reports for senior management on cloud performance, security posture, and incident management.
• Troubleshoot and resolve issues related to cloud services, network connectivity, and automation workkflows.

Qualifications

• Bachelor’s degree in computer science, Information Technology, or a related field; or equivalent professional experience.
• Minimum of 4+ years of experience in delivering Talend-based data engineering solutions in consulting/client-facing environments.
• Proficiency in o SQL (joins, window functions, aggregates, basic indexing/tuning) o Python (scripts/utilities; custom steps, API integrations; Py. Spark exposure is a plus)
• Hands-on experience in data modeling, indexing, and query performance tuning.
• Hands-on with: o Talend Studio (Integration): Job/Joblet design, contexts, repository metadata, CDC/SCD patterns. o Talend Cloud Admin (TMC): environments, roles, engines/runtimes, scheduling, monitoring. o Talend Data Catalogue: glossaries, lineage, classifications, stewardship workflows. o Talend Data Quality: profiling, rules, standardization, deduplication, DQ KPIs.
• Proficiency in vulnerability management across platforms (Windows, Linux, Network devices etc.)
• Working knowledge of firewalls, network and server security, SSL certificates and security best practices.
• Certifications (Preferred): o Talend Data Integration Certified Developer o Talend Data Catalog Certified Implementer o Talend API Services Certified Developer o Talend Big Data Certified Developer
• Experience with Microsoft 365 administration (e.g., Exchange, SharePoint, OneDrive, Teams).
• Experience with backup, disaster recovery, and business continuity planning.
• Strong understanding of cloud security risks, including data breaches, malware, and social engineering.
• Excellent collaboration skills for working with cross-functional teams and providing leadership in cloud security projects.
• Experience working in a team, able to lead, prioritize and execute tasks in a high-pressure environment and provide or make sound decisions in emergencies.