Key Responsibilities:
• Design, develop, and maintain scalable data pipelines for collecting, storing, and processing large volumes of data from various sources.
• Work with data architects and other engineers to build data models that ensure the integrity, accuracy, and accessibility of data.
• Integrate data from disparate sources, ensuring data is clean, reliable, and easy to access.
• Collaborate with data scientists, analysts, and business stakeholders to understand their data needs and implement solutions to meet them.
• Monitor and troubleshoot data pipelines to ensure data is being processed accurately and in a timely manner.
• Optimize data storage and retrieval processes for efficiency, scalability, and cost-effectiveness.
• Implement best practices for data security and privacy.
• Maintain and enhance data infrastructure and tools, ensuring they are up-to-date and aligned with business needs.
• Assist with the documentation of data systems and processes for internal use.
