Hadoop Sre Engineer jobs at Citi Group in Canada

Key Responsibilities:

• Lead all phases of the software development lifecycle (SDLC), from feasibility studies and cost estimation to deployment, maintenance, and user support. This includes analysis, design, coding, testing, and implementation.
• Provide technical expertise and guidance to business users, stakeholders, and other technology teams.
• Analyze complex business and system processes, evaluate industry best practices, and recommend innovative programming solutions.
• Design and implement robust security measures throughout the SDLC, ensuring system integrity and data protection.
• Build and manage CI/CD pipelines, coordinating deployments, releases, and associated documentation.
• Collaborate with users, clients, and other technical groups to address issues, propose solutions, and implement systems.
• Define and maintain operating standards and procedures, ensuring adherence to best practices.
• Mentor and coach junior team members, fostering their professional development.
• Operate with a high degree of autonomy and sound judgment, making informed decisions that consider business risks and align with company policies and regulations.
• Act as a subject matter expert (SME) for stakeholders and team members.
• Prioritize the firm's reputation and safeguard its assets by adhering to applicable laws, regulations, and ethical guidelines.
• Participate actively in building and maintaining a strong engineering culture.

Required Skills/Experience:

• 7+ years of hands-on professional software development experience.
• Proficiency in Java, Python, JavaScript, or React.
• Experience building RESTful APIs using frameworks like Spring.
• Experience working with event-driven systems, microservices, and micro-frontend UIs.
• Proven ability to follow TDD and clean code principles.
• Strong understanding of data structures, algorithms, and SQL.
• Ability to work independently in a fast-paced and rapidly changing environment.

Preferred Skills/Experience:

• Familiarity with cloud services like AWS and distributed systems such as Kafka, Kubernetes, S3, DynamoDB, MongoDB, or other NoSQL databases.
• Experience working in the investment banking or financial services industry.
• Experience with Java/J2EE, Spring Boot, Hibernate, and RESTful web services (XML, JSON).
• Extensive experience with Core Java, including multi-threading and collections framework.
• Deep understanding of persistent storage technologies (RDBMS like Oracle, SQL Server).
• Experience in the payments domain.
• Experience working in Agile (Scrum/Kanban) and distributed teams.

Education:

• Bachelor's degree in Computer Science, Engineering, or a related field involving software programming or systems engineering.

Other Relevant Skills

Responsibilities:

• Manage multiple teams of professionals to accomplish established goals and conduct personnel duties for team (e.g. performance evaluations, hiring and disciplinary actions)

• Provide strategic influence and exercise control over resources, budget management and planning while monitoring end results

• Utilize in-depth knowledge of concepts and procedures within own area and basic knowledge of other areas to resolve issues

• Ensure essential procedures are followed and contribute to defining standards

• Integrate in-depth knowledge of applications development with overall technology function to achieve established goals

• Provide evaluative judgement based on analysis of facts in complicated, unique, and dynamic situations including drawing from internal and external sources

• Influence and negotiate with senior leaders across functions, as well as communicate with external parties as necessary

• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Qualifications:

• 10+ years of relevant experience as a hands-on technologist with people management background

• 10 + years experience in application development using Java as the primary programming language

• Experience in applications development utilizing Spring Boot, Apache Spark, and Microservices based architecture

• Experience building & managing ETL pipelines

• Data Storage –HBASE, Hadoop, SQL, Oracle, Redis

• Experience managing global technology teams

• Cloud experience and Financial Services background is a plus

• Expertise operating within an Agile / Scrum Project Management methodology

• Working knowledge of industry practices and standards

• Consistently demonstrates clear and concise written and verbal communication

Education:

• Bachelor’s degree/University degree or equivalent experience

• Master’s degree preferred

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

Other Relevant Skills

The Lead Data Engineer will be responsible for designing, implementing, and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System(HDFS) and S3 Storage using Apache Kafka, Flink Java and Flink SQL, Apache Spark and Python. This role requires deep understanding of data engineering principles, proficiency in Java, Python and hands-on experience with Kafka and S3 ecosystems. Developer will collaborate with data engineers, analysts, and business stakeholders to process, transform and drive insights and data driven decisions.Responsibilities:

• Subject Matter Expert (SME) in Finance and Risk data with experience in data processing jobs to handle large-scale data in Hadoop Distributed File System (HDFS), S3 Storage using Apache Spark, Apache Kafka Streaming, Apache Flink Java, Flink SQL and Python.
• Good programming skills in Java, SQL and Python
• Distribute data to downstream systems by generating feeds or publishing to Kafka topics
• Required to support situations in which end user consultation is required to identify system function specifications and incorporate them into overall system design and delivery. Additionally, utilize comprehensive knowledge of multiple areas within technology to achieve technological objectives.
• Expected to effectively communicate those risks to the business owners, so that they can make informed decisions.
• Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
• Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
• Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
• Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
• Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
• Ensure essential procedures are followed and help define operating standards and processes
• Serve as advisor or coach to new or lower level analysts
• Has the ability to operate with a limited level of direct supervision.
• Can exercise independence of judgement and autonomy.
• Acts as SME to senior stakeholders and /or other team members.

Qualifications:

• 8+ years of relevant experience in Hadoop Distributed File System(HDFS) using Apache Spark, Python, Java and SQL
• 2+ years of relevant experience in S3 Storage using Apache Kafka, Flink Java and Flink SQL with minimal latency, monitor and optimize the performance of Kafka clusters, troubleshoot and resolve issues related to Kafka and data processing, implement best practices for Kafka architecture and operations
• Experience in systems analysis and programming of software applications
• Experience in managing and implementing successful projects
• Working knowledge of consulting/project management techniques/methods
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
• Strong communication skills and attention to detail and accuracy.
• Demonstrated leadership skills.
• Basic knowledge of industry practices and standards
• Consistently demonstrates clear and concise written and verbal communication

Education:

• Bachelor's degree/University degree or equivalent experience
• Prior Financial industry experience will be a plus

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

Additional Responsibilities:

Data Processing and Transformation:

• Design and implement big data warehouse application to process and transform large datasets
• Develop ETL Pipelines with Apache Kafka, Flink, Spark, Python for data Ingestion, cleaning, aggregation, and transformations.

Data Distribution:

• Send data to downstream systems by generating feeds or publishing to Kafka topics

Performance Optimization:

• Optimize ETL jobs for efficiency, reducing run time and resource usage.
• Finetune memory management, caching, and partitioning strategies for Optimal performance

Data Engineering with Hadoop, Spark, Kafka, Flink:

• Load data from different sources into S3 Storage, ensuring data accuracy and integrity.
• Testing and debugging:

• Troubleshoot and debug Kafka Job failures, monitor job logs, and Kaka UI Manager to Identify Issues.

Coding standard adherence:

• Coding vulnerabilities identification and addressing. Enforcement of the coding standard to eliminate code vulnerabilities.
• Bigdata best practice adherence including small files elimination, Hive SRE scan success and archival implementation for ideal architecture utilizations.

Time Type:

Responsibilities:

• Develop framework for portfolio risk assessment including evaluation of credit and financial performance across varied lending products and industry segments
• Understand applicable credit policies, industry regulations and the requisite impact of those governance items to prospective new partners or product initiatives
• Establish and leverage cross-functional partnerships and network with key internal and external constituencies
• Utilize Statistical Analysis System (SAS) in a UNIX environment to perform risk, financial and data analyses including profiling, sampling, forecasting and new program due diligence
• Prepare risk management presentations for senior management that include analytics on expected portfolio performance and areas of potential risk and/or opportunity
• Has the ability to operate with a limited level of direct supervision.
• Can exercise independence of judgement and autonomy.
• Acts as SME to senior stakeholders and /or other team members.
• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Qualifications:

• 6-10 years of experience in mortgage servicing risk management or equivalent training and experience preferably in the financial services industry
• Proven ability to apply credit and risk principles toward business goals
• Demonstrated ability to synthesize and prioritize
• Proven ability to remain organized in a fast-paced environment
• Demonstrated interpersonal, organizational and analytic skills

Education:

• Bachelor's degree/University degree or equivalent experience
• Master's degree preferred

Anticipated Posting Close Date:

The Quality Engineer - Automation is a seasoned professional role. Applies in-depth disciplinary knowledge, contributing to the development of new techniques and the improvement of processes and work-flow for the area or function. Integrates subject matter and industry expertise within a defined area. Requires in-depth understanding of how areas collectively integrate within the sub-function as well as coordinate and contribute to the objectives of the function and overall business. Evaluates moderately complex and variable issues with substantial potential impact, where development of an approach/taking of an action involves weighing various alternatives and balancing potentially conflicting situations using multiple sources of information. Requires good analytical skills in order to filter, prioritize and validate potentially complex and dynamic material from multiple sources. Strong communication and diplomacy skills are required. Regularly assumes informal/formal leadership role within teams. Involved in coaching and training of new recruits Significant impact in terms of project size, geography, etc. by influencing decisions through advice, counsel and/or facilitating services to others in area of specialization. Work and performance of all teams in the area are directly affected by the performance of the individual.Responsibilities:

• Supports initiatives related to all testing cycles, including User Acceptance Testing (UAT) process and product rollout into production. Testing specialists who work with technology project managers, UAT professionals and users to design and implement appropriate scripts/plans for an application testing strategy/approach.
• Hands on experience in functional and automation testing.
• Tests and analyzes a broad range of systems and applications to ensure they meet or exceed specified standards and end-user requirements.
• Work closely with key stakeholders to understand business and functional requirements to develop test plans, test cases and scripts.
• Works complex testing assignments.
• Executes test scripts according to application requirements documentation.
• Identifies defects and recommends appropriate course of action; performs root cause analyses.
• Coordinates multiple testers and testing activities within a project.
• Retests after corrections are made to ensure problems are resolved.
• Documents, evaluates and researches test results for future replication.
• Identifies, recommends and implements process improvements to enhance testing strategies.
• Analyzes requirements and design aspects of projects. Interfaces with client leads and development teams.
• Exhibits sound understanding of concepts and principles in own technical area and a basic knowledge of these elements in other areas.
• Requires in-depth understanding of how own area integrates within IT testing and has basic commercial awareness.
• Makes evaluative judgments based on analysis of factual information in complicated and novel situations.
• Participate in test strategy meetings,
• Has direct impact on the team and closely related teams by ensuring the quality of the tasks services information provided by self and others.
• Requires sound and comprehensive communication and diplomacy skills to exchange complex information.
• Provide metrics related to the cost, effort, and milestones of Quality activities on a project level
• Acts as advisor and mentor for junior members of the team.
• Regularly assumes informal/formal leadership role within teams.
• Perform other duties and functions as assigned
• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Qualifications:

• 5-8 years Testing Analyst experience
• Familiarity with the Software Development Lifecycle (SDLC) and how Quality Assurance methodology fits into the SDLC Knowledge of relevant operating systems, languages and database tools Knowledge of defect tracking systems and processes; including change management Knowledge of automated regression testing tools. Experience of testing trading platforms or similar software. Ability to work under pressure during tight dead lines
• Requires methodical approach to testing and problem solving. Requires theoretical and analytical skills, with demonstrated ability in planning and operations
• Excellent communication and stakeholder management skills with a proactive attitude, always seeking opportunities to add value
• Specific software languages will be dependent of area of business

Education:

• Bachelor’s/University degree or equivalent experience

Time Type:

Whether you’re at the start of your career or looking to discover your next adventure, your story begins here. At, you’ll have the opportunity to expand your skills and make a difference at one of the world’s most global banks. We’re fully committed to supporting your growth and development from the start with extensive on-the-job training and exposure to senior leaders, as well as more traditional learning. You’ll also have the chance to give back and make a positive impact where we live and work through volunteerism.

Shape your Career with Citi

Citi’sRisk Managementorganization oversees risk-taking activities and assesses risks and issues independently of the front line units. We establish and maintain the enterprise risk management framework that ensures the ability to consistently identify, measure, monitor, control and report material aggregate risks.

Hybrid(Internal Job Title: Risk Reporting Sr. Officer I - C14) based in Mumbai, India.Being part of our team means that we’ll provide you with the resources to meet your unique needs, empower you to make healthy decision and manage your financial well-being to help plan for your future. For instance:

• Citi provides programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more. Coverage varies by country.
• We believe all parents deserve time to adjust to parenthood and bond with the newest members of their families. That’s why in early 2020 we began rolling out our expanded Paid Parental Leave Policy to include Citi employees around the world.
• We empower our employees to manage their financial well-being and help them plan for the future.
• Citi provides access to an array of learning and development resources to help broaden and deepen your skills and knowledge as your career progresses.
• We have a variety of programs that help employees balance their work and life, including generous paid time off packages.
• We offer our employees resources and tools to volunteer in the communities in which they live and work. In 2019, Citi employee volunteers contributed more than 1 million volunteer hours around the world.

Responsibilities:

• Lead and mentor a team of experienced Python developers, cultivating a collaborative and high-performing environment.
• Design, develop, and maintain Python-based applications for risk assessment, monitoring, and reporting, adhering to best practices and regulatory standards.
• Utilize Business Intelligence tools, preferably Tableau, to create insightful dashboards and visualizations that effectively communicate risk information to stakeholders.
• Partner with risk management professionals, business stakeholders, and technology teams to gather requirements, translate them into technical specifications, and deliver impactful solutions.
• Play a key role in EUC remediation efforts, contributing to the migration of end-user computing tools to robust and controlled platforms.
• Actively participate in the implementation of ITeSS (Information Technology End-User Services and Support), focusing on enhancing the efficiency and effectiveness of IT services for risk management.
• Contribute to the development and execution of multi-year data plan initiatives, ensuring alignment with strategic objectives and optimizing data utilization for risk analysis.
• Provide technical guidance and coaching to team members, promoting continuous learning and professional development.
• Conduct code reviews, enforce quality assurance, and manage the deployment of risk applications.
• Communicate complex technical concepts clearly and concisely to both technical and non-technical audiences.

As a successful candidate, you’d ideally have the following skills and exposure:

• Proven track record of leading and mentoring development teams, fostering collaboration and innovation.
• With 17+ of over-all experience, 12+ years of which should be extensive experience developing and deploying Python-based applications, including data processing, analysis, and visualization.
• Strong proficiency in Business Intelligence tools, preferably Tableau, with demonstrated ability to create interactive dashboards and reports.
• Good understanding of risk management principles, methodologies, and regulatory requirements .
• Excellent communication, interpersonal, and presentation skills, with the ability to explain complex technical concepts to diverse audiences.
• Experience with EUC remediation, ITeSS implementation, or similar initiatives is highly desirable.

Education:

• Bachelor's degree in Computer Science, Engineering, or a related field is required.
• A Master's degree and/or Certification in a relevant field is highly preferred.

Time Type:

• Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
• Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
• Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
• Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
• Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
• Ensure essential procedures are followed and help define operating standards and processes
• Serve as advisor or coach to new or lower level analysts
• Has the ability to operate with a limited level of direct supervision.
• Can exercise independence of judgement and autonomy.
• Acts as SME to senior stakeholders and /or other team members.
• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
• Design and develop automation tools to reduce manual effort in environment management, deployment process, and system monitoring.
• Build self-service solution and CI/CD pipelines to improve delivery speed.
• Drive reliability and scalability by identifying pain points and implementing tooling that enhances platforms performance and reduces operational overhead

• 5-8 years of relevant experience
• Experience in systems analysis and programming of software applications
• Experience in managing and implementing successful projects
• Working knowledge of consulting/project management techniques/methods
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
• Strong scripting / programming experience with a focus on production and operational improvement (PowerShell, shell script, java, python, SQL)
• Hands on experience with CI/CD(Jenkins, uDeploy), Spring Boot Tools
• Autosys configuration
• Windows/Linux Environment

• Bachelor’s degree/University degree or equivalent experience

Time Type: