The point where experts and best companies meet
Share
About the Role
Be responsible for data engineering activities including data ingestion, data modelling, data processing data governance
Be a data steward to educate and promote the data importance and data-driven culture.
Be constantly challenged to learn and grow with new technologies, identify and solve complex problems via data
Collaborate with the key stakeholders, product owners, external vendors to define solutions for business and technical requirements.
About You
7+ years of professional experience in software and big data with most of them from a product company
Experience developing large-scale data processing pipelines and implementing ETL using modern tools & best practices
Experience on large-scale multi-tier cloud applications and environments
Have deep understanding on data engineering principles, hands-on experience of large-scale analytics systems
Strong knowledge of SQL (MySQL, PostgreSQL) and preferably experience with NoSQL databases
Extensive experience with various AWS services (e.g. EC2, S3, Athena, Lambda, Kinesis Firehose, Redshift)
Experience with Airflow, EKS, EMR, Redshift, Kubernetes · Good Hadoop ecosystem knowledge (e.g. Hadoop, Spark, Kafka, Hive, Presto)
Proficient in at least one programming language and scripting languages (Python, Java, Scala, Bash)
Experience with CICD tools such as Github Actions and CircleCI
Familiar with Agile/Scrum software development methodologies
BS or MS in Computer Science or equivalent education
Excellent written and verbal communication and presentation skills to effectively communicate information to all levels within the organization
Bonus Skills
DevOps skills: create build & install scripts, terraform, UNIX-based systems management, release management, production monitoring, etc.
Experience creating visualization & dashboards using tools like Tableau or Apache Superset ·
Experience with Health or IOT or Mobile Device Management business · Experience with Lakehouse architectures and table formats such as Apache Iceberg, Apacha Hudi or Delta Lake
Operational experience tuning & debugging large volume Spark jobs
Skills and Qualifications
The salary range for this role is expected to be between$97,070 to $144,540and reflects base salary only. Actual pay will be determined based on a number of factors and may vary depending on job-related knowledge, competencies, qualifications, relevant skills and experience.
Please note that we reserve the right to modify or remove job postings at any time.
These jobs might be a good fit