This job is responsible for driving efforts to develop and deliver complex data solutions to accomplish technology and business goals. Key responsibilities include leading code design and delivery tasks with the integration, cleaning, transformation and control of data in operational and analytical data systems. Job expectations include liaising with vendors and working with stakeholders and Product and Software Engineering teams to implement data requirements, analyzing performance, and researching and troubleshooting issues within system engineering domains.
Responsibilities:
- Leads story refinement and delivery of requirements through the delivery lifecycle and assists team members in resolving technical complexities
- Codes complex solutions to integrate, clean, transform, and control data, builds processes supporting data transformation, data structures, metadata, data quality controls, dependency, and workload management, assembles complex data sets, and communicates required information for deployment
- Leads documentation of system requirements, collaborates with development teams to understand data requirements and feasibility, and leverages architectural components to develop client requirements
- Leads testing teams to develop test plans, contributes to existing test suites including integration, regression, and performance, analyzes test reports, identifies test issues and errors, and leads triage of underlying causes
- Leads work efforts with technology partners and stakeholders to close gaps in data management standards adherence, negotiates paths forward by thinking outside the box to identify and communicate solutions to complex problems, and leverages knowledge of information systems, techniques, and processes
- Leads complex information technology projects to ensure on-time delivery and adherence to release processes and risk management and defines and builds data pipelines to enable data-informed decision making
- Mentors Data Engineers to enable continuous development and monitors key performance indicators and internal controls
Managerial Responsibilities:
This position may also have responsibilities for managing associates. At Bank of America, all managers at this level demonstrate the following responsibilities, in addition to those specific to the role, listed above.
- Diversity & Inclusion Champion: Creates an inclusive team where members are treated fairly and respectfully.
- Manager of Process & Data: Demonstrates and expects process knowledge, data driven decisions, simplicity and continuous improvement.
- Enterprise Advocate & Communicator: Delivers clear and concise messages that motivate, convey the “why” and connects contributions to business results.
- Risk Manager: Leads and encourages the identification, escalation and resolution of potential risks.
- People Manager & Coach: Knows and develops team members through coaching and feedback.
- Financial Steward: Manages expenses and demonstrates an owner’s mindset.
- Enterprise Talent Leader: Recruits, on-boards and develops talent, and supports talent mobility for career growth.
- Driver of Business Outcomes: Delivers results through effective team management, structure, and routines.
Skills:
- Analytical Thinking
- Application Development
- Data Management
- DevOps Practices
- Solution Design
- Agile Practices
- Collaboration
- Decision Making
- Risk Management
- Test Engineering
- Architecture
- Business Acumen
- Data Quality Management
- Financial Management
- Solution Delivery Process
Required Skills
- Experience with multiple large scale Enterprise Hadoop environment builds and operations including design, capacity planning, cluster set up, security, performance tuning and monitoring.
- Experience with the full Cloudera CDP distribution to install, configure and monitor all services in the CDP stack.
- Strong understanding of core Cloudera Hadoop services such as HDFS, MapReduce, Kafka, Spark and Spark-Streaming, Hive, Impala, HBASE, Sqoop, and Oozie.
- Experience in administering, and supporting RHEL Linux operating systems, databases, and hardware in an enterprise environment.
- Expertise in typical system administration and programming skills such as storage capacity management, debugging, performance tuning.
- Proficient in shell scripting (e.g. BASH, ksh, etc.)
- Experience in setup, configuration and management of security for Hadoop clusters using Kerberos with integration with LDAP/AD at an Enterprise level.
- Experience with scaling enterprise data into the ecosystem.
Desired Skills
- Expertise in writing python scripts and debugging existing scripts.
- Enterprise Database Administration Experience.
- Experience In Large Analytic Tools including SAS, Search, Machine Learning, Log Aggregation.
- Experience with Hadoop distributions in the Cloud is a plus, AWS, Azure, Google.
- Experience with Apache Nifi a plus.
Minimum Education Requirement:Bachelor Degree or equivalent working experience
1st shift (United States of America)