Product AI Application Backend Engineer

Job description

**About Us** Established in 2018, Bybit is one of the world’s leading cryptocurrency exchanges and digital financial platforms, serving over 80 million users across more than 200 countries and regions. Powered by world-class technology and a user-first mindset, Bybit delivers a seamless ecosystem across trading, payments, wealth management, custody, institutional services, and Web3 — connecting users to the future of digital finance. Our core values define how we build. We listen, care and improve to create products and experiences that put users first. Backed by a global team of ambitious builders, problem-solvers, and innovators, we foster a high-performance and fast-moving environment where talent is empowered to drive real impact at the global scale. Supported by 24/7 multilingual customer service and a strong commitment to innovation, we are shaping the future of finance through technology, collaboration, and bold execution. Today, Bybit is recognized as one of the most trusted and transparent platforms in the digital asset industry, continuing to expand its global presence while building the infrastructure for the next generation of financial services. **About the Role** We are using AI to fundamentally reshape our core business infrastructure. As an **AI Application Backend Engineer**, you will be a core builder of AI engineering capabilities — deeply integrating large language models with financial business scenarios to construct the backend AI service layer powering trading intelligence, smart risk control, compliance monitoring, and user services. **Responsibilities** - **AI Service Layer** **Architecture** **& Development**: Design and develop core AI backend services, including model gateway (Model Gateway), Agent scheduling layer, and streaming inference services. Build high-concurrency, low-latency, horizontally scalable microservice architectures that meet production SLA requirements for AI-powered services. - **Agent & Tool-Calling System Development**: Develop Agent workflows and tool-calling (Tool Use / Function Calling) systems on the Openclaw platform. Define tool registration and integration standards for internal systems (trading engine, risk systems, data platforms), ensuring call-level security and result integrity for financial scenarios. - **Financial Scenario AI Service Delivery**: Own the development and iteration of AI backend services for core scenarios including intelligent customer service, risk signal detection, compliance analysis, and personalized services. Collaborate with algorithm teams to deliver end-to-end model integration, effectiveness validation, and performance tuning. - **Data & Storage Layer**: Design and maintain data infrastructure required by AI applications, including session memory and long-term memory storage, knowledge base management and incremental update mechanisms — ensuring data consistency and retrieval quality. - **Observability & Evaluation**: Establish full-chain LLM application tracing, prompt version management, and evaluation frameworks. Design automated LLM-as-Judge pipelines to continuously monitor output quality, hallucination rates, and business KPIs. **Requirements** - **Programming Fundamentals**: Proficiency in **Golang** or **Java**; solid understanding of data structures, algorithms, and system design; familiarity with RESTful API and gRPC interface design. - **Backend Engineering Experience**: **5+ years** of backend development experience with production-level expertise in microservice frameworks (Spring Boot / go-zero), message queues (Kafka / RabbitMQ), caching (Redis), and relational databases (PostgreSQL / MySQL). - **LLM/Agent Engineering in Production**: **1+ year** of hands-on production experience building LLM applications or AI Agents, with demonstrated AI skills (Agent development, LLM toolchain integration); able to independently deliver AI feature modules end-to-end. - **Prompt Engineering & Model Understanding**: Deep understanding of LLM capabilities and limitations (hallucination, context length, reasoning); hands-on experience with Prompt Engineering, Few-shot and Chain-of-Thought design, with the ability to independently craft and iterate prompt strategies for complex business scenarios. **Why Join Us** At Bybit, we are committed to fostering a supportive and enriching work environment. Our benefits include: - Study Growth Fund: We support your professional development and continuous learning. - Internal Events: Participate in regular team-building activities, workshops, and events designed to promote collaboration and innovation. - Global Collaboration: Be part of a diverse, international team, working alongside colleagues from around the world. - Career Advancement: Access opportunities for growth and advancement within a rapidly expanding global company. - Internal Mobility: Grow with us- Your long-term development is important to us. We offer internal job opportunities to help build your career path.