Senior Data Engineer-AOS, Hybrid

เขตพระขโนง กรุงเทพมหานคร
ไม่ระบุ Baht
Job description

Career category :  IT / Programmer

Education level :  Senior High School/Vocational Certificate

Experience : 5 year

Vacancies : 1


Responsibilities

**Hybrid** เข้าออฟฟิศสัปดาห์ละ 2 วัน

- Experience with big data such as Vertica, Apache Airflow

- ชำนาญ ETL

- สร้าง Customer Single view โดยรวมข้อมูลเข้าด้วยกันรวมถึงต้องทำการ initial data , migration data ชุดใหญ่ ๆ

- สามารถ processing data กลุ่มนี้เป็น result ที่ต้องการอีก

- มีความชำนาญ Airflow , Spark , Databrick

Job Responsibilities :

-Analyze and organize raw data.

-Combine raw information from different sources.

-Designing and building data models to support business requirements.

-Developing and maintaining data ingestion and processing systems.

-Implementing data storage solutions (databases and data lakes)

-Ensuring data consistency and accuracy through data validation and cleansing techniques

-Conduct complex data analysis and report on results.

-Explore ways to enhance data quality and reliability.

-Working together with cross-functional teams to identify and address data-related issues

-Writes unit/integration tests, contributes to engineering wiki, and documents work.


Qualification
  1. BS or MS degree in Computer Science or a related technical field.
  2. 5+ years experience as a data engineer or in a similar role.
  3. Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  4. Experience building and optimizing data pipelines, architectures and data sets.
  5. 5+ years of Python or Java development experience, 5+ years of SQL experience (No-SQL experience.
  6. A successful history of manipulating, processing and extracting value from large disconnected datasets.
  7. Experience with big data such as Vertica.
  8. Familiarity with data integration and ETL tools such as Apache Airflow , Data flow.
  9. Experience with orchestration tools e.g. batch and real-time data processing.
Related job titles

This website uses cookies

line