Data Engineer CÔNG TY CỔ PHẦN CÔNG NGHỆ GIÁO DỤC NATIVE X

Data Pipeline Management (60%) - Hands on Bash scripting experience and building data pipelines on Linux/Unix systems. - Utilise Python and SQL, along with Dataframes, to transform and ingest data into BigQuery from various sources, including MongoDB and Postgresql. - Maintain and enhance the design of data pipelines, ensuring efficient data ingestion and transformation processes. - Troubleshoot and resolve technical issues related to the server, pipelines, and data processing. - Optimize SQL queries and tune server configurations to enhance performance of the data platform.

Health insurance, Social Insurance, and Unemployment Insurance according to regulations Provide laptops for employees. Health insurance for all employees. 12 days annual leave, 1 birthday leave & 1 Christmas day leave.

- At least 2-3 years of experience as a Data Engineer. - Proficient in Python and SQL for data transformation, ingestion, and manipulation. - Hands-on experience with BigQuery, MongoDB, and Postgresql, including schema design and optimization techniques. - Proficiency in bash scripting, enabling automation of data-related tasks and workflows, including the creation and execution of shell scripts for diverse data engineering processes. - Skilled in Apache Airflow, encompassing orchestration of complex data workflows, task scheduling, monitoring using DAGs, familiarity with Operators and Executors, and expertise in managing Airflow server for cluster performance and reliability. - Excellent communication skills to effectively collaborate with cross-functional teams, translating business requirements into technical solutions. - Experience with Docker, including containerization of services, managing Dockerized applications, and utilising Docker Compose for streamlined deployment and scalability. - Familiarity with version control systems to manage codebase efficiently. - Communicate and collaborate with overseas technical teams, ensuring clear understanding of requirements. - Problem-solving skills.