**Introduction**Software Developers at IBM are the backbone of our strategic initiatives to design, code, test, and provide industry-leading solutions that make the world run today - planes and trains take off on time, bank transactions complete in the blink of an eye and the world remains safe because of the work our software developers do. Whether you are working on projects internally or for a client, software development is critical to the success of IBM and our clients worldwide. At IBM, you will use the latest software development tools, techniques and approaches and work with leading minds in the industry to build solutions you can be proud of.**Your Role and Responsibilities**We are currently looking for a talented hands-on tech lead / manager to lead our data infrastructure team. This role reports directly to the head of infrastructure. The tech lead will lead an engineering team focused on infrastructure and data platform powering transformative AI/ML products reaching tens of millions of customers per day, feeding billions of customers worldwide. The department covers data infrastructure, data lakes, warehouse, data pipelines, analysis, and performance optimization.**Responsibilities**:- Build, lead and mentor a team of infrastructure engineers in a fast-moving and quickly growing organization across- Architect big data and batch + real-time analytical solutions that leverage hybrid datastore technologies operating at petabyte scale- Collaborate with ML/AI teams to develop features and APIs to support use cases spanning analytics, research, triage, and monitoring- Develop and maintain pipelines to manage resilient idempotent coordination with external databases, APIs and systems- Identify and address functionality, stability and scalability design decisions across the stackCRCW_22**Required Technical and Professional Expertise**- 5+ years of experience in data infrastructure with at least 2 years proven experience leading a team of engineers preferably at petabyte scale.- 5+ years of Python experience working in Linux/Unix environments.- Strong experience developing infrastructure powering products and services operating in high performance, distributed systems in large-scale, open-source Linux/Unix environment.- Strong understanding of databases, distributed systems, data lakes, data warehouses, workflow systems and event streaming.- Experience with modern, large scale data processing technologies such as Hadoop, Hive, Spark, Presto and Impala- Fluent in English**Preferred Technical and Professional Expertise**- Experience with pub/sub pipelines and dataflows such as Kafka, SQS, MQTT.- Experience with API design, Apache Avro, and protobuf.- Experience with AWS technologies such as EMR, Redshift, kinesis, MSK, S3, RDS, and EKS.- Demonstrated ability to facilitate and coordinate complex API design and implementation activities across teams in agile sprints with mínimal direction**About Business Unit**Are you craving to learn more? Prepared to solve some of the world's most unique challenges? And ready to shape the future for millions of people? If so, then it's time to join us, express your individuality, unleash your curiosity and discover new possibilities.Every IBMer, and potential ones like yourself, has a voice, carves their own path, and uses their expertise to help co-create and add to our story. Together, we have the power to make meaningful change - to alter the fabric of our clients, of society and IBM itself, to create a truly positive impact and make the world work better for everyone.It's time to define your career.**About IBM**Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we're also one of the biggest technology and consulting employers, with many of the Fortune 50 companies relying on the IBM Cloud to run their business.At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it's time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.**Location Statement**IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
