Adventure's around the corner...

Senior Software Engineer (Spark) - Cloud Data Platform

  • DepartmentProduct Development and Operations
  • LocationUnited States - San Mateo, CA
  • Location TypeHybrid
Guidewire Software is an insure-tech software company with more than 3,200 people in 40+ countries worldwide. We are an internet-scale, cloud-native, real-time data platform built for the property and casualty insurance industry worldwide.

Are you passionate about building internet-scale multi-tenant cloud-native data platforms?

Do you have prior experience in building data platforms/data lake and analytics SaaS services in the public cloud with expertise in modern Big Data stack (Apache Spark, Hadoop, Kafka, Flink, Hive etc.)

If so then come join our Cloud Data Platform team! This team owns, builds, and operates Guidewire’s cloud-native data platform and analytics SaaS offerings. The Guidewire Data Platform is an enterprise-grade, internet-scale, and cloud-native Big Data platform targeted to be best-in-class in enabling our customers with mission-critical insights and decision-making capabilities.
The platform is designed to support all our analytics, data science, and data applications. Guidewire’s data platform already processes Billions of real-time data to provide a rich set of AI/ML SaaS solutions! You will work in a highly collaborative environment building next-generation platforms and services using the latest and greatest cutting-edge & bleeding-edge technologies.  You will have fun building cloud-native, enterprise-grade, and internet-scale platforms and SaaS applications.

Required Skills:

  • 8+ years' experience working in a similar Senior Software Engineer role within a data platform/data engineering team
  • Extensive experience with Big Data and distributed systems.
  • Experience with stream processing using Spark.
  • Ability to design large-scale distributed systems.
  • Prior experience in building data platforms using Big Data stack (Kafka, Hadoop, Spark, Flink, Hive ..) on the public cloud.
  • Excellent programming skills in Java.
  • Understanding of distributed systems concepts and principles (consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms).
  • Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques.
  • Eager to learn new things and passionate about technology!.
  • Comfortable working with Kubernetes, AWS, Docker, and Terraform.

What you would do:

  • Hands-on coding and implementation of high-performance Spark applications, leveraging your deep understanding of distributed computing and data processing.
  • Designing and optimizing Spark applications.
  • Design cloud-native data platform and analytics SaaS services
  • Own architecture and provide technical leadership to multiple teams
  • Hands-on coding>60% of the time
  • Design and build large-scale real-time stream processing systems
  • Design and develop micro-services and analytics SaaS solutions
  • Own scalability, availability, and data security
  • Own, tackle & resolve code defects
  • Mentor junior developers in standards and best practices!

What you would need to succeed:

  • Extensive experience working on a public cloud-like AWS
  • Prior experience and passion for building a large-scale multi-tenant cloud-native data platform
  • Emphasize team wins over individual success
  • Strong technical interpersonal skills
  • Excellent software development skills in one or more of the following languages: Java/Scala
  • Extensive experience with Big Data and distributed systems.
  • Expertise in Spark or Flink, Kafka, and Hadoop ecosystem
  • Ability to design large-scale distributed systems
  • Have developed in more than one language and ready to pivot to any language/framework
  • Understand microservices architecture patterns pattern like Service Discovery/API Gateway/Domain Driven Design etc
  • Experience with containers technology
  • Ability to work in an agile fast-paced environment
  • BS or MS degree (Computer Science or Math)

  • Bonus
  • AWS (EMR, S3, Glue, Kinesis)
  • Debezium
  • ELK
  • Experience in building SaaS/PaaS on AWS/GCP/Azure.
  • AI/ML

Be Yourself & Stay Clever

At Guidewire, we value autonomy, empowerment, and inclusivity, which is why we want each of our employees to be heard and celebrated. We’re in the business of uplifting people, so they can fulfill their goals and ambitions. So, there’s plenty of time and space for you to broaden your skills and experience.
If we've got you excited and you’re ready for a career upgrade, then we're eager to hear from you! Get in touch to learn more about the Guidewire team you’ll work with.

Our employee culture

Who We Are


Salary Information

Salary Range: $125000 - $229000 per year

Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Please note that the compensation details listed in US role postings reflect the base salary only, and do not include bonus, equity, or benefits.

About Guidewire

Guidewire is the platform P&C insurers trust to engage, innovate, and grow efficiently. We combine digital, core, analytics, and AI to deliver our platform as a cloud service. More than 540+ insurers in 40 countries, from new ventures to the largest and most complex in the world, run on Guidewire.

As a partner to our customers, we continually evolve to enable their success. We are proud of our unparalleled implementation track record with 1600+ successful projects, supported by the largest R&D team and partner ecosystem in the industry. Our Marketplace provides hundreds of applications that accelerate integration, localization, and innovation.

For more information, please visit and follow us on Twitter: @Guidewire_PandC.

Guidewire Software, Inc. is proud to be an equal opportunity and affirmative action employer. We are committed to an inclusive workplace, and believe that a diversity of perspectives, abilities, and cultures is a key to our success. Qualified applicants will receive consideration without regard to race, color, ancestry, religion, sex, national origin, citizenship, marital status, age, sexual orientation, gender identity, gender expression, veteran status, or disability. All offers are contingent upon passing a criminal history and other background checks where it's applicable to the position.

Disability Accommodations and Guidewire’s Appeals Process. Guidewire provides accommodations to the hiring process to create a fair opportunity for candidates with disabilities to contend for open positions. Accommodation requests should be directed to (650) 356-4940 or If things do not go as hoped, we invite you to use our appeals process. Guidewire promises to independently review any denied accommodation and any decision not to offer you the position. The appeals process is the same in either case. Within five business days of receiving a notice of denial of an accommodation, or receiving a notice of your non-selection for a vacancy, call (650) 356-4940 or e-mail to make an appeal. Guidewire will assign a new decision-maker to review the request and/or hiring decision, who will then notify you in writing of a decision within 10 business days.
Talent rewards

The perks. The rewards. The good stuff.

We’re proud to shout about our awesome benefits packages. Holistic wellness is a big deal for us. We offer everything you need to support your work and, most importantly, your work-life balance. We’re committed to helping you be the best version of yourself. Inside and outside of work.



Receive market-competitive pay and incentive programs—because you deserve it! To help future-proof your income, we offer generous support through retirement savings plans.



Keep your physical and emotional health in tip-top shape with health insurance for you and your family, an employee assistance program, annual wellness reimbursement, and access to wellness resources.



Work in an environment where you’ll have the freedom and trust to make an impact, with time for your life outside of work.



Relax and kick back through our generous paid time-off programs. Make a difference in your community with three volunteer days each year. Take your own personal day of rest with My Day. We also offer ample paid leave for all new parents.



We encourage self-directed learning, giving you every chance to become a better version of yourself, both professionally and personally. At Guidewire, lifelong learning is here for the taking.



Your career opportunities are only limited by your own imagination. Guidewire’s community is filled with chances to expand your horizons across any of our teams or worldwide‌‌‌‌‌‌‌ locations.