Data Scientist Open Search

IntroductionA career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You’ll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.Your role and responsibilitiesAs a senior professional in this role, you will be responsible for optimizing search performance, analyzing semantic search quality, and improving query optimization. Your duties will include profiling and rewriting slow queries, shard and cluster tuning, and managing index lifecycle for sustained performance. You will also be involved in developing and implementing strategies to improve search relevance, leveraging techniques such as natural language processing (NLP) and machine learning (ML) to drive innovation in search technology.Required technical and professional expertise * Experience with vector search, particularly approximate nearest neighbors (HNSW) and filtered vector search * Knowledge of search relevance analysis and improvement * Query optimization skills, including profiling and rewriting slow queries * Experience with shard and cluster tuning for sustained performance * Familiarity with managing large-scale Open. Search projects (>100M vectors, >200GB data) Preferred technical and professional experience * Experience with data science techniques, including machine learning, deep learning, and natural language processing * Knowledge of data visualization tools and techniques to communicate insights to stakeholders * Familiarity with agile development methodologies and version control systems * Experience with cloud-based technologies, such as AWS or Azure * Understanding of data-driven decision making and ability to drive business outcomes through data analysis and insights IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.