Position Overview:
As a Senior Data Engineer, you will be a key player in shaping our next-generation cloud data infrastructure. You will design and implement cutting-edge, scalable architectures, optimize high-volume data pipelines, and drive innovation in real-time data processing and analytics. This role offers an exciting opportunity to work with the latest AWS technologies, machine learning models, and automation frameworks to deliver high-performance, data-driven solutions that empower law enforcement agencies worldwide.
Responsibilities:
- Innovative Data Architecture & Design: Architect, design, and implement highly scalable, secure, and cost-efficient AWS-based data solutions using Apache Spark, Kubernetes, and AWS-native services utilizing AI-driven optimizations and real-time streaming capabilities.
- Define best practices for cloud-native data modeling, event-driven architectures, and high-performance computing.
- Advanced Data Pipeline Development: Build, optimize, and maintain intelligent ETL/ELT pipelines leveraging AWS Glue, Apache Spark on EMR, and Lambda functions for automated data workflows.
- Innovate with real-time streaming solutions using AWS Kinesis, Kafka, to enable instant decision-making capabilities.
- Enhance data workflows with dynamic autoscaling and resource optimization.
- Data Governance & Security Excellence: Implement advanced data governance frameworks, ensuring compliance, data lineage tracking, and AI-driven anomaly detection.
- Strengthen security with cutting-edge AWS security tools, including IAM, KMS, and end-to-end encryption mechanisms.
- Collaboration & Thought Leadership: Collaborate with cross-functional teams, including AI/ML engineers, data scientists, and software developers, to build intelligent, data-driven solutions.
- Mentor and inspire team members, fostering a culture of innovation and technical excellence.
- Operational Efficiency & Optimization: Monitor and enhance data pipelines and infrastructure using predictive analytics and automated observability tools.
- Continuously optimize cloud costs and performance, leveraging serverless architectures and infrastructure as code (IaC) solutions like Terraform and AWS CDK.