Data Engineer TPS Software

- We are seeking a highly skilled and experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for developing, implementing, and maintaining data solutions using various technologies and platforms. * Your key responsibilities:
- Design, develop, and maintain data pipelines and workflows
- Implement data transformations, ensure optimal performance and scalability
- Design and implement scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services
- Develop efficient and robust ETL processes to extract, transform, and load data from various sources
- Build and maintain data models, ensuring data integrity and quality
- Implement and optimize data storage solutions, leverage its capabilities for scalability, reliability, and security
- Collaborate with cross-functional teams
- Monitor and optimize data pipelines for performance, reliability, and cost-effectiveness
- Stay up-to-date with the latest trends and technologies in the field of data engineering and recommend improvements to existing systems and processes

- Company trip

- BHXH/PVI

- Technical Training

- Bachelor’s degree in Computer Science, Engineering, or a related field. Master’s degree is a plus
- At least 3 years of experience as a Data Engineer or similar role
- Familiarity with Data Lakehouse Architecture concepts, principles, and best practices
- Experience with Azure: ADF, Databricks, SQL DW, Azure Functions, Serverless Architecture
- Proficient in working with Azure blob storage for scalable and secure data storage
- Hands-on experience with Delta Lake for managing big data workloads efficiently
- Experience with both relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra)
- Proficiency in Python for scripting and automation tasks
- Knowledge of real-time data processing tools and frameworks (e.g., Apache Kafka, Apache Flink) for streaming data
- Experience with data visualization tools (e.g., Tableau, Power BI)