Amazon Data Engineer Amazon Music DISCO 

India, Karnataka 

591382730

Key job responsibilities- Construct resilient and scalable data pipelines using SQL/PySpark/Airflow to effectively ingest, process, and transform substantial data volumes from diverse sources into a structured format, ensuring data quality and integrity.
- Devise and implement an efficient, scalable data warehousing solution on AWS, utilizing appropriate NoSQL/SQL storage and database technologies for both structured and unstructured data.
- Automate ETL/ELT processes to streamline data integration from diverse sources, enhancing the platform's reliability and efficiency.- Enable advanced analytics and machine learning capabilities within the platform, extracting predictive and prescriptive insights through tools like EMR/SageMaker Notebooks.
- Continuously monitor and optimize the performance of data pipelines, databases, and applications, ensuring low-latency data access for analytics and machine learning tasks.
- Implement robust security measures and ensure data compliance with internal requirements, industry standards, and regulations to safeguard sensitive information.
- Collaborate closely with data scientists and business intelligence engineers to comprehend their requirements and work together on data-related projects.
- Generate comprehensive technical documentation covering the platform's architecture, data models, and APIs, promoting knowledge sharing and ease of maintainability.

- 3+ years of data engineering experience

- Master's degree