Dempsey Resource Management Inc. Cloud Data Engineer

Dempsey Resource Management Inc.

NT$31.4-36.6K[شهريًا]

في الموقع - مدينة كويزون3-5 سنوات خبرةبكالوريوسدوام كامل

Design, build, and maintain cloud-based data pipelines and workflows that support analytics and operational systems.
Integrate data from various sources using APIs and cloud services.
Develop clean, efficient, and test-driven code in Python for data ingestion and processing.
Optimize data storage and retrieval using big data formats like Apache Parquet and ORC.
Implement robust data models, including relational, dimensional, and NoSQL models.
Collaborate with cross-functional teams to gather and refine requirements and deliver high-quality solutions.
Deploy infrastructure using Infrastructure as Code (IaC) tools such as AWS

At least 3 years in a data engineering role working on data integration, processing, and transformation use cases with open-source languages (i.e. Python) and cloud technologies.
With Strong programming skills in Python specifically for API integration and data libraries,with emphasis on quality and test-driven development.
Demonstrated proficiency with big data storage formats (Apache Parquet, ORC) and practical knowledge of pitfalls and optimization strategies.
Demonstrated proficiency with SQL
Experience with data modeling:

Glue, IAM, Lambda, DynamoDb, Step Functions, S3,CloudFormation or CDK
Must be willing to work on a hybrid setup, with onsite reporting to Quezon City.
Must be available to start by June 1, 2025.
Engagement is project-based for 6 months, with a possibility of extension.
With experience in Athena, Kinesis, MSK, MWAA, SQS

Experience with orchestration of data flows/pipelines: Apache Airflow or Dagster

Experience with data streaming (Kinesis, Kafka)
Experience with Apache Spark
Client-facing experience, multi-cultural team experience, technical leadership, team leadership

AthenaKinesisMSKSQL