המקום בו המומחים והחברות הטובות ביותר נפגשים
As a Data Engineer, you will work on designing, building, and supporting scalable data infrastructure solutions in a large, complex data environment.Responsibilities include:
- Contributing to development and performance improvement of AI/ML models through implementation of robust data pipelines- Implementing solutions to aggregate data and enable fast yet secure data retrieval- Collaborating with cross-functional teams including business owners and technology leaders to understand requirements, design technical solutions, and develop pipelines and datasets
- Staying up-to-date on emerging technologies in the data space and evaluating new technologies for potential implementation
- Contributing to system scalability, reliability, and efficiencyWe welcome people with diverse backgrounds who meet the required skills and qualifications. Excellent communication and collaboration abilities are valued to work closely with stakeholders across the organization. Relevant experience with current big data technologies is preferred. We provide opportunities to gain exposure to cutting edge AWS services and encourage professional development.Key job responsibilities
- Contribute to the architecture, design, and implementation of next generation Data solutions
- Manage AWS resources including EC2, ECS, Lambda, Redshift, etc.A day in the life
Our Data Engineers build and maintain the infrastructure to answer questions with data, using software engineering best practices, data management fundamentals, data storage principles, and recent advances in distributed systems (e g MapReduce, MPP architectures, NoSQL database).
- Experience in data engineering
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
- Experience with one or more scripting language (e.g., Python, KornShell)
- Knowledge of AWS Infrastructure
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.
- Knowledge of BI analytics, reporting or visualization tools like Tableau, AWS QuickSight, Cognos or other third-party tools
משרות נוספות שיכולות לעניין אותך