Why We Want You**This position may be a Full Time employment or a Contractor role**
• Be responsible for system architecture design and data engineering activities including data ingestion, modelling, processing and data governance
• Work with team to improve the data pipeline to process large scale data efficiently
• Be a data steward to educate and promote the data importance and data-driven culture.
• Be constantly challenged to learn and grow with new technologies, identify and solve complex problems via data
• Collaborate with cross-functional teams, including data scientists and business stakeholders.
• Design and implement data architecture that supports analytical needs and scalability
• Implement and maintain cloud-based data solutions for various use cases ranging from batch data processing, near-real time data pipelines and AI/ML solutions
• Document systems, workflows, and processing to maintain transparency and knowledge sharing
Skills and Qualifications
- 7+ years of professional experience in Data Engineering with most of them from a product company
- Architecture design and development of large-scale data platform and data applications
- Good experience with large-scale multi-tier cloud applications and environments
- Have deep understanding on data engineering principles, hands-on experience of high availability systems and API design
- Strong knowledge of SQL (e.g. MySQL, PostgreSQL) and preferably experience with NoSQL databases and data warehouse solution
- Extensive experience with AWS services (e.g. EC2, S3, Athena, Lambda, Redshift, EKS, Open Search) or Google Cloud Platform services (e.g. Big Query, Google Analytics)
- Good experience with open-source technologies such as Airflow, Superset, Datahub, Great Expectation
- Good Hadoop ecosystem knowledge (e.g. Hadoop, Spark, Kafka, Hive, Presto)
- Proficient in at least one programming language and scripting languages (e.g. Python, Scala, Java, Bash)
- Good experience with CICD tools such as GitHub Actions
- Familiar with Agile/Scrum software development methodologies
- BS or MS in Computer Science or equivalent education
- Excellent written and verbal communication and presentation skills to effectively communicate information to all levels within the organization
Bonus Skills
- DevOps skills: create build & install scripts, terraform, UNIX-based systems management, release management, production monitoring, etc.
- AWS or GCP or Azure related certification
- Experience with ML/AI engineering, BI engineering work
- Experience with mobile Device Management business
The salary range for this role is expected to be between $97,070 to $144,540 and reflects base salary only. Actual pay will be determined based on a number of factors and may vary depending on job-related knowledge, competencies, qualifications, relevant skills and experience.
Please note that we reserve the right to modify or remove job postings at any time.