Mackenzie is the Global Startup Evangelist at AWS. His days are spent traveling the globe to meet startups, share their stories, and connect engineering teams together. Every day there are a large number of startups launching on AWS across every imaginable industry. It’s Mackenzie’s mission to find stories of startups that are helping to improve the world and share these stories with a wide audience.
The AWS Open Source Symposium will focus on the two themes of Data Analytics and Developer Platforms built with CNCF technologies.
For Developer Platforms, we will be discussing, 1/Components of a Developer Platform, 2/Building or Assembling Developer Platforms, 3/Operating Developer Platforms, and 4/Existing Tooling and Technologies.
ÂÂFor Data Analytics and AI/ML, we will be discussing customers' open source implementations on Kubernetes and their integration with AWS services, such as Open Source Spark, Iceberg, Hudi, Trino, JupyterHub, and more.
We will also focus on running scalable data workloads on Kubernetes and discussing Cloud Native Batch Systems, such as Apache YuniKorn and Volcano batch schedulers, as well as any multi Kubernetes cluster batch schedulers like Armada.
ÂÂThe goal of the symposium is to bring customers together to share thoughts on how they are using these solutions to solve big data and observability use cases, as well as to discuss lessons learned and mistakes to avoid.
Many real-world cloud-native apps are delivered together with heritage products. Teams face the challenge of supplying a complex assembly of products in a compliant way across multiple security boundaries and clouds. In this talk, we present a solution that began at SAP and re-imagines how to merge these requirements. We start with the Open Component Model (OCM), an open standard with an open-source toolkit to describe software components in a technology agnostic way.
With the help of Weaveworks, OCM integrates with Flux to create GitOps Localization. We present the security, compliance, and automation benefits of OCM and GitOps Localization for air-gapped environments, end-to-end supply chain shielding, and lift and shift applications to the cloud. We will show you how to package, transport, and deploy signed, attestable, and verifiable artifacts into environments with limited or no connectivity and high-security clouds.
Speakers: Jason Kafka - Software Engineering Manager - SAP SE, Ingo Kober - Product Owner - SAP SE
In recent years, there has been an increasing trend of financial institutions leveraging self-service and GitOps technologies. These technologies enable faster and more efficient deployment of applications and services while reducing the risk of human error.
Crossplane, an open-source multi-api control plane , has been proven to be particularly effective in implementing these technologies in a banking environment. The combination of Crossplane and GitOps can help banks increase their agility, reduce downtime, and achieve a more streamlined infrastructure.
During this talk, we will provide a comprehensive overview of Crossplane, its benefits and how it can be used in the financial sector. Additionally, we will highlight the importance of GitOps in a banking environment and how it can be used to manage and automate the deployment of applications and services.
Speaker: Christoher Haar, Lead Engineer, DKB
There's always room for debate on where to draw the thin line between service uptime and velocity in a multi-tenant environment. At Adobe, we had those constructive debates raised by the pain that we had to suffer from both perspectives, which ultimately led to successfully developing and adopting an upgrade strategy, called "ParkNodes", to address the problem from a reliability standpoint. It uses the same Kubernetes drain paradigm respecting service PDBs, but it puts a timebox constraint to it, followed by a park and asynchronously evict loop. In this talk, we will give a historical overview of the various cluster upgrade procedures we used to run, the ups and downs of every single one, and how we came up with today's strategy. The ParkNodes evict loop is open sourced at https://github.com/adobe/k8s-shredder.
Speaker: Alexandru Dobre, Technical Lead Computer Scientist, Adobe
Kubernetes has become the de-facto orchestration platform that automates the deployment, scaling, and management of containerized microservices/applications. However, managing complex applications, including those built for multiple cloud environments, can be challenging, especially when it comes to tasks such as configuring, upgrading, and monitoring. Kubernetes Operators are a powerful extension to Kubernetes that provides a way to automate the management of complex applications, including tedious DevOps and administrative operations. Operators are in fact software extensions that can be deployed on a Kubernetes cluster to monitor specific Custom Resources Definitions (CRD) defined by the admins. They will ultimately enable developers to automate routine and repetitive tasks, simplify application management, and scale applications more efficiently. Mo Haghighi, Distinguished Engineer at Discover Financial Services, will explore the advantages of Kubernetes operators for boosting developers’ productivity and how enterprises can expedite their modernisation journey and automate their multi-cloud deployment by adopting operators.
Speaker: Mo Haghighi, Director, Distinguished Engineer, Discover Financial Services
As customer datalakes mature and scale, often governence requirements expand in complexity. For customers at Strategic scale, utilizing open-source analytics toolchains, the best practice of assigning IAM roles to clusters/ec2-nodes for S3 data access bounds a cluster to a particular set of permissions, not granular enough to provide per-job customized S3 permissions required by FGAC.In tight collaboration with AWS, Pinterest developed a credential vending platform (CVS) for assigning granular permissions to their analytics platform at runtime, allowing multi jobs of different privilege to run securely on a single converged cluster. THis approach simplified the overall management of their analytics platform by reducing the number of clusters whilst simultaneously improving their security posture by ensuring least-priviledge for each individual job.
Speaker: Keith Regier, Engineering Manager Data Governance, Pinterest
Navteca will showcase the power of open-source software with success stories from the Science Managed Cloud Environment (SMCE) at U.S National Aeronautics and Space Administration (NASA) Goddard. Our presentation focuses on two flagship projects of the SMCE: the Community Coordinated Modeling Center (CCMC) and the Space Weather Science Operations Center (SWxSOC), which supports the Heliophysics Environmental and Radiation Measurement Experiment Suite (HERMES) flown on the Lunar Gateway. We will highlight how the Open Science Studio utilizes cloud flexibility to empower NASA scientists to work more efficiently and effectively, and how HERMES takes advantage of NASA's open-source push to standardize data processing and leverage the power of the Amazon Web Services (AWS) cloud.
Â
Speakers: Damian Barrous-Dume - DevOps Engineer, NASA / Navteca, ÂÂFrancisco Rivas - Senior Solutions Architect, NASA / Navteca
The CNCF Landscape offers an incredible and diverse ecosystem of frameworks, technologies, and platforms. Your teams have their own implementations of these technologies. Onboarding new developers is super confusing, and docs are scattered around the place. In short: chaos and fragmentation in dozens of different tools. The solution to this might be… another portal? Backstage, an open source platform you can use to build your own developer portal. It is highly customisable and adopted by companies like Unity, Netflix, American Airlines, and Epic Games.
We'll explore the components and concepts that make up Backstage and learn how it helps organisations to manage the chaos. We’ll cover how core features such as the Software Catalog and software templates are changing the way end users interact and manage their ecosystem. Let’s shape the future of developer experience together! 🎉
Speaker: Lee Mills, Senior Engineering Manager, Spotify
Privacy | Site Terms |Â