Your responsibilities
Build custom Python connectors to ingest data from diverse external APIs into Bigquery data warehouses via Fivetran.
State & Sync Logic: Design efficient sync strategies implementing date-windowed incremental syncs, full refreshes, and state checkpointing to handle network interruptions cleanly.
Assess Temetra data structures, source availability, refresh requirements and integration dependencies.
Define source-to-target mappings for meter reads, events, asset and operational data.
Configure sync schedules, incremental loads, error handling, retry logic and monitoring alerts.
Validate data accuracy through reconciliation checks, completeness checks and data quality rules.
Troubleshoot ingestion failures, schema drift, latency issues and downstream data inconsistencies.
Document integration design, data flows, runbooks, monitoring approach and handover procedures.
Your Profile
Essential skills/knowledge/experience:
Advanced Python (3.10 or later) development, virtual environment management, and modern package dependency management.
API Engineering: Strong experience interacting with REST/GraphQL endpoints, handling various auth paradigms (Basic Auth, OAuth 2.0), custom pagination, and JSON response payload parsing.
Experience designing source-to-target mappings, ingestion patterns and reconciliation approaches.
Ability to diagnose data issues including schema changes, failed loads, duplicate records and missing data.
Understanding of batch, incremental and near-real-time data ingestion concepts.
Strong documentation skills for technical design, interface specification, data flow and operational runbooks.
Ability to work with application, data engineering, analytics and business stakeholders
Desirable skills/knowledge/experience:
• Fivetran Connector SDK & CLI: Practical experience with fivetran-connector-sdk operations would be advantageous.
• Exposure to Temetra or similar smart metering / meter data management platforms.
• Utilities or water-sector experience, especially meter reads, consumption data, events, leakage or asset data.
• Experience integrating operational platforms into cloud data warehouses such as BigQuery, Snowflake or Databricks.
• Awareness of access control and data handling expectations for regulated utility data.