המקום בו המומחים והחברות הטובות ביותר נפגשים
The ideal candidate will work backwards from our customers and stakeholders to understand analytical requirements in the domains of Transportation Procurement as well as Customs & Trade. You get to work with very large datasets, design and build end-to-end ETL and data warehousing solutions. You will leverage AWS services and other Amazon big data technologies, along with engineering best practices to deliver the availability, speed, and scalability required by the business. You will focus on the automation and optimization across all data engineering areas. The ideal candidate should also have strong data engineering and analysis skills and can build BI and ML solutions alongside Business Intelligence Engineers and Data Scientists on the team. The candidate will also work alongside software developers to help build front end web applications with backend data integration.Key job responsibilities
- Design, implement and maintain an analytical data infrastructure providing ad-hoc access to large datasets and computing power
- Monitor and optimize database cluster performance and overall health with the implementation of work load management and other mechanisms
- Extract, transform, and load data from a wide variety of sources using SQL and cloud computing technologies where appropriate
- Implement automated solutions to improve data quality and protect data integrity with a focus on efficiency and scalability
- Bachelor's degree
- 3+ years of data engineering experience
- Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets
- Experience with SQL
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience in at least one cloud platform (like AWS, Azure, Google Cloud etc.)
- Master's degree
- 5+ years of data engineering experience
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- Experience working in the transportation and logistics industry
- Knowledge of statistical modeling and advanced quantitative analytical techniques
משרות נוספות שיכולות לעניין אותך