Igor Soarez

Kafka champion for all of Apple, hands on lead for managed Kafka service in internal cloud.

Bootstrapped Apple's expertise in Kafka internals, replacing 2.5M/y support contract, and participation/influence in the open source project. Became first Kafka commiter from Apple.

Designed and implemented JBOD support in KRaft for Apache Kafka (KIP-858)

Troubleshoot design flaw / bug in Kafka & Java causing loss of two nines of availability.

Built a container based framework to test and troubleshoot Apache Kafka, reducing feedback cycles from hours to a couple of minutes.

Built support for running Kafka on Kubernetes, introduced operator pattern, cut provisioning time from days to under ten minutes and enabled active self healing.

Enabled self service to managed Kafka via Kubernetes CRDs and an operator.

Developed Kafka load testing tool to saturate bare-metal (512Gb RAM 10Gb NIC) hosts

Built config management system for hundreds of clusters in bare-metal, Kubernetes and AWS

Engineering, operating and improving global systems <100ms latency, 1 M+ QPS.

Information extraction on petabytes of data to prevent fraud and to describe the interests and trends of the online community.

Developing and operating ML systems and infrastructure to run advertising campaigns at a global scale using a proprietary MapReduce cluster and global real-time bidding system.

Lead engineer in marketplace platform with 3M daily active users, rolled out to 7 countries.

Pushed wide architectural changes for better UX (faster load times) and lower costs.

Designed and implemented authentication system for client-to-server and server-to-server.

Created popular developer toolkit enabling faster troubleshooting, testing and knowledge sharing.