27
Sat, Apr
1 New Articles

Celebrating 40 Years of Db2: Running the World’s Mission Critical Workloads

Typography
  • Smaller Small Medium Big Bigger
  • Default Helvetica Segoe Georgia Times

On June 7, 1983, a product was born that would revolutionize how organizations would store, manage, process, and query their data: IBM Db2.

Over the past 40 years, Db2 has been on an exciting and transformational journey. In 1969, retired IBM Fellow Edgar F. Codd published his famous paper “A Relational Model of Data for Large Shared Data Banks.” His paper and research went on to inspire Donald D. Chamberlin and Raymond F. Boyce to create Structured Query Language (SQL)

IBM Db2 was announced in 1983, and V1.1 launched on MVS in 1985. Don Haderle, a retired IBM Fellow and considered to be the “father of Db2,” viewed 1988 as a seminal point in its development as DB2 version 2 proved it was viable for online transactional processing (OLTP)—the lifeblood of business computing at the time. Thus, was born a single database and the relational model for transactions and business intelligence.

Success on the mainframe led to ports on OS/2, AIX, Linux, Unix, Windows, and other platforms running on both IBM and non-IBM hardware. Db2 (LUW) was born in 1993, and 2023 marks its 30th anniversary.

The impact of Db2 on IBM

Db2 helped position IBM as an overall solution provider of hardware, software, and services. Its early success, coupled with IBM WebSphere in the 1990s, put it in the spotlight as the database system for several Olympic games, including 1992 Barcelona, 1996 Atlanta, and the 1998 Winter Olympics in Nagano. Performance and stability were critical in preventing any failures or delays that could be visible to millions of viewers.

Built on decades of innovation in data security, scalability and availability, IBM Db2 keeps business applications and analytics protected, highly performant, and resilient, anywhere. Forrester’s 2022 Total Economic Impact Report for Data Management highlights the impact Db2 and the IBM data management portfolio is having for customers:

  • Return on investment (ROI) of 241% and payback <6 months.
  • Benefits Present Value (PV) of $3.43M and Net Present Value (NPV) of $2.42M
  • Three-year benefits include higher growth through better customer experience of $1.76M, automation-driven productivity gains of $1.20M, and data-driven operational improvements of $473K

What is IBM Db2 (LUW)?

IBM Db2 (LUW) is the cloud-native database built to power lowlatency transactions and real-time analytics at scale, providing customers with both self-managed and fully managed (SaaS) options on the cloud. It provides a single engine for DBAs, enterprise architects and developers to keep critical applications running. It also stores and queries anything and powers faster decision-making across organizations.

For the past three decades, Db2 has provided stability and dependability for customers’ data management solutions. Its robust architecture and proven performance have given businesses uninterrupted access to critical data while powering their enterprise-level applications.

Db2 v11.5 was a significant leap forward in data management, empowering organizations to unlock the full potential of their data. 

How Db2, AI and hybrid cloud work together

AI-infused intelligence in IBM Db2 v11.5 enhances data management through automated insights generation, self-tuning performance optimization and predictive analytics. It leverages machine learning algorithms to continuously learn and adapt to workload patterns, delivering superior performance and reducing administrative efforts. In addition, robust tooling and integration with popular development frameworks enable rapid application development and deployment. Developers can leverage features like REST APIs, JSON support and enhanced SQL compatibility to easily build cloud-native applications. Db2 v11.5 is a proven, versatile, and AI-ready solution. 

Db2 Universal Container (also known as Db2u) is a containerization technology based on microservices architecture. In this environment, each component is separated into services that run in one of more containers. This architecture improves fault isolation because applications can remain largely unaffected by any failure of a single microservice. Overall, it is easier to deploy. Provisioning, scaling, and redundancy control are managed automatically. Db2 can run on Red Hat OpenShift and Kubernetes environments, ROSA & EKS on AWS, and ARO & AKS on Azure deployments.

Customers can also choose to run IBM Db2 database and IBM Db2 Warehouse as a fully managed service. Db2 database SaaS is a fully managed service for a highperformance, transactional workload. Db2 Warehouse SaaS, on the other hand, is a fully managed elastic cloud data warehouse with our columnar technology. Both services offer independent compute and storage scaling, high availability, and automated DBA tasks. 

watsonx.data integration

At Think, IBM announced watsonx.data as a new open, hybrid and governed data store optimized for all data, analytics, and AI workloads. It is built on open data lakehouse architecture and brings together the commodity Cloud Object Store, open data/table formats and open-source query engines. Watsonx.data will be fully integrated with Db2 Warehouse—in particular, it will be able to access data in Db2 tables using a Db2 connector, while Db2 can also access watsonx.data data directly by cataloging its metastore and share data in open formats such as Parquet and Apache Iceberg table format. Watsonx.data uses cost-efficient compute and storage and fit-for-purpose query engines such as Presto and Spark, that automatically scale up and down. This now gives Db2 Warehouse customers the ability to augment existing workloads and reduce costs by pairing the right workload with the right engine based on price and performance needs. Additionally, Db2 transactional data can be combined with new data in watsonx.data to gain new insights and deploy AI at scale.

Connecting Db2 and Db2 for z/OS

Mainframes continue to store much of the world’s most valued data. The platform is capable of 110,000 million instructions per second, which (doing the math) translates into a theoretical 9.5 trillion instructions per day. With such high-value data, much of which holds highly sensitive financial and personal information, the mainframe is a potential target for cyber criminals. Thankfully, the IBM Z platform is designed to be one the most securable platforms. In fact, the IBM z16 is industry’s first quantum-safe system.

The invention of parallel sysplex and Db2 data sharing remains a seminal moment in the history of databases and a staggering technological achievement. Overall, this demonstrates the advantages gained from the deep integration and synergy that exists between software and hardware on the IBM mainframe. Parallel sysplex and Db2 data sharing delivers the ultimate in scalability and continuous availability for mission-critical workloads.

Diving into Db2 for z/OS Version 13 innovations

IBM Db2 for z/OS version 13, released May 2022, brings further leading-edge innovation to reinforce Db2 for z/OS as a foundation for enterprise computing within the hybrid cloud world.

Db2 13 for z/OS delivers significant advances in all critical enterprise database success factors—availability, scalability, performance, security, and ease of use. The value of Db2 13 is also maximized by synergy with surrounding tools and technology. The latest advances in IBM Z hardware couple with AI technology through SQL Data Insights to deliver first-of-its-kind semantic SQL query support for unprecedented business value from data.

New and improved application development tooling, new capabilities like AI infusion for enhanced operational efficiency as well as IBM Db2 Data Gate complement the new capabilities in Db2 13

Delivering hybrid transactional and analytical processing

Db2 for z/OS can deliver enterprise-scale hybrid transactions/analytical processing (HTAP), thanks to patented consistency and coherency model and its heterogeneous scale-out architecture.

The ability to ingest hundreds of thousands of rows each second is critical for more and more applications, particularly for mobile computing and the Internet of Things (IoT). With the IoT, tracking website clicks, capturing call data records for a mobile network carrier, tracking events generated by “smart meters” and embedded devices can all generate huge volumes of transactions.

Many consider a NoSQL database essential for high data ingestion rates. Db2, however, allows for very high insert rates without having to partition or shard the database—all while being able to query the data using standard SQL with Atomicity, Consistency, Isolation, Durability (ACID) compliance on the world’s most stable, highly available platform.

In 2016, Db2 for z/OS moved to a continuous delivery model that provides new capabilities and enhancements through the service stream in just weeks (and sometimes days) instead of multi-year release cycles. This delivers increased agility while maintaining customer-related quality, reliability, stability, and security. Coupled with a continuous delivery model, Db2 continues to invest in availability, performance, and scalability to cope with the most demanding workloads of today and the future. Overall, this supports millions of inserts a second, trillions of rows in a single table and more.

IBM Db2 for z/OS is the data server at the heart of many of today’s data warehouses, powering IBM analytics solutions like Cognos, SPSS, QMF, ML for z/OS, IBM Db2 Analytics Accelerator, Data Gate and more. Db2 for z/OS has created a sense of “Data Gravity,” where its high value prompts organizations to co-locate their applications and analytics solutions with their data. This helps remove unnecessary network and infrastructure latencies and reduce cost and security vulnerabilities.

The sheer volume and velocity of the transaction workloads, the richness of data in each transaction and the data in log files is a potential gold mine for machine learning and AI applications to exploit cognitive capabilities, creating a more intelligent and secure solution. IBM Watson Machine Learning for z/OS was recently released, built on open-source technology, and leveraging the latest innovations while making any perceived complexities of the platform transparent to data scientists through the IBM Data Science Experience interface.

Let’s celebrate

After four decades, let’s all applaud IBM Db2 and IBM Db2 for z/OS’s unwavering reliability, its pioneering spirit, and its impressive impact on the world of data management. Db2 has been a trusted companion for businesses, consistently adapting to the evolving needs of enterprises and enabling them to thrive in the digital era. 

Let’s also applaud the technological innovation and quality that has been the hallmark of Db2 from the start and its impact upon the world of data management. Db2—whether on Z or LUW—is the trusted platform for business, continuously adapting to the evolving needs of the world’s most demanding enterprises, enabling them to thrive in the digital and AI era. Db2 stands ready to embrace new challenges and opportunities within AI in the hybrid cloud data ecosystem. With its rich legacy and relentless commitment to innovation, Db2 will continue to shape the future of data management and inspire generations to come. 

Thank you to the many talented people that have participated in the success of Db2’s past, present, and future. 

I would like to also thank my coauthors Namik Hrle, Vikram Murali, Haakon Roberts, and Dr. Michael Kwok for their contributions to this blog post.

IBM is a leading global hybrid cloud and AI, and business services provider, helping clients in more than 175 countries capitalize on insights from their data, streamline business processes, reduce costs and gain the competitive edge in their industries. Nearly 3,000 government and corporate entities in critical infrastructure areas such as financial services, telecommunications and healthcare rely on IBM's hybrid cloud platform and Red Hat OpenShift to affect their digital transformations quickly, efficiently, and securely. IBM's breakthrough innovations in AI, quantum computing, industry-specific cloud solutions and business services deliver open and flexible options to our clients. All of this is backed by IBM's legendary commitment to trust, transparency, responsibility, inclusivity, and service.

For more information, visit: www.ibm.com.

BLOG COMMENTS POWERED BY DISQUS

LATEST COMMENTS

Support MC Press Online

$0.00 Raised:
$

Book Reviews

Resource Center

  • SB Profound WC 5536 Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application. You can find Part 1 here. In Part 2 of our free Node.js Webinar Series, Brian May teaches you the different tooling options available for writing code, debugging, and using Git for version control. Brian will briefly discuss the different tools available, and demonstrate his preferred setup for Node development on IBM i or any platform. Attend this webinar to learn:

  • SB Profound WP 5539More than ever, there is a demand for IT to deliver innovation. Your IBM i has been an essential part of your business operations for years. However, your organization may struggle to maintain the current system and implement new projects. The thousands of customers we've worked with and surveyed state that expectations regarding the digital footprint and vision of the company are not aligned with the current IT environment.

  • SB HelpSystems ROBOT Generic IBM announced the E1080 servers using the latest Power10 processor in September 2021. The most powerful processor from IBM to date, Power10 is designed to handle the demands of doing business in today’s high-tech atmosphere, including running cloud applications, supporting big data, and managing AI workloads. But what does Power10 mean for your data center? In this recorded webinar, IBMers Dan Sundt and Dylan Boday join IBM Power Champion Tom Huntington for a discussion on why Power10 technology is the right strategic investment if you run IBM i, AIX, or Linux. In this action-packed hour, Tom will share trends from the IBM i and AIX user communities while Dan and Dylan dive into the tech specs for key hardware, including:

  • Magic MarkTRY the one package that solves all your document design and printing challenges on all your platforms. Produce bar code labels, electronic forms, ad hoc reports, and RFID tags – without programming! MarkMagic is the only document design and print solution that combines report writing, WYSIWYG label and forms design, and conditional printing in one integrated product. Make sure your data survives when catastrophe hits. Request your trial now!  Request Now.

  • SB HelpSystems ROBOT GenericForms of ransomware has been around for over 30 years, and with more and more organizations suffering attacks each year, it continues to endure. What has made ransomware such a durable threat and what is the best way to combat it? In order to prevent ransomware, organizations must first understand how it works.

  • SB HelpSystems ROBOT GenericIT security is a top priority for businesses around the world, but most IBM i pros don’t know where to begin—and most cybersecurity experts don’t know IBM i. In this session, Robin Tatam explores the business impact of lax IBM i security, the top vulnerabilities putting IBM i at risk, and the steps you can take to protect your organization. If you’re looking to avoid unexpected downtime or corrupted data, you don’t want to miss this session.

  • SB HelpSystems ROBOT GenericCan you trust all of your users all of the time? A typical end user receives 16 malicious emails each month, but only 17 percent of these phishing campaigns are reported to IT. Once an attack is underway, most organizations won’t discover the breach until six months later. A staggering amount of damage can occur in that time. Despite these risks, 93 percent of organizations are leaving their IBM i systems vulnerable to cybercrime. In this on-demand webinar, IBM i security experts Robin Tatam and Sandi Moore will reveal:

  • FORTRA Disaster protection is vital to every business. Yet, it often consists of patched together procedures that are prone to error. From automatic backups to data encryption to media management, Robot automates the routine (yet often complex) tasks of iSeries backup and recovery, saving you time and money and making the process safer and more reliable. Automate your backups with the Robot Backup and Recovery Solution. Key features include:

  • FORTRAManaging messages on your IBM i can be more than a full-time job if you have to do it manually. Messages need a response and resources must be monitored—often over multiple systems and across platforms. How can you be sure you won’t miss important system events? Automate your message center with the Robot Message Management Solution. Key features include:

  • FORTRAThe thought of printing, distributing, and storing iSeries reports manually may reduce you to tears. Paper and labor costs associated with report generation can spiral out of control. Mountains of paper threaten to swamp your files. Robot automates report bursting, distribution, bundling, and archiving, and offers secure, selective online report viewing. Manage your reports with the Robot Report Management Solution. Key features include:

  • FORTRAFor over 30 years, Robot has been a leader in systems management for IBM i. With batch job creation and scheduling at its core, the Robot Job Scheduling Solution reduces the opportunity for human error and helps you maintain service levels, automating even the biggest, most complex runbooks. Manage your job schedule with the Robot Job Scheduling Solution. Key features include:

  • LANSA Business users want new applications now. Market and regulatory pressures require faster application updates and delivery into production. Your IBM i developers may be approaching retirement, and you see no sure way to fill their positions with experienced developers. In addition, you may be caught between maintaining your existing applications and the uncertainty of moving to something new.

  • LANSAWhen it comes to creating your business applications, there are hundreds of coding platforms and programming languages to choose from. These options range from very complex traditional programming languages to Low-Code platforms where sometimes no traditional coding experience is needed. Download our whitepaper, The Power of Writing Code in a Low-Code Solution, and:

  • LANSASupply Chain is becoming increasingly complex and unpredictable. From raw materials for manufacturing to food supply chains, the journey from source to production to delivery to consumers is marred with inefficiencies, manual processes, shortages, recalls, counterfeits, and scandals. In this webinar, we discuss how:

  • The MC Resource Centers bring you the widest selection of white papers, trial software, and on-demand webcasts for you to choose from. >> Review the list of White Papers, Trial Software or On-Demand Webcast at the MC Press Resource Center. >> Add the items to yru Cart and complet he checkout process and submit

  • Profound Logic Have you been wondering about Node.js? Our free Node.js Webinar Series takes you from total beginner to creating a fully-functional IBM i Node.js business application.

  • SB Profound WC 5536Join us for this hour-long webcast that will explore:

  • Fortra IT managers hoping to find new IBM i talent are discovering that the pool of experienced RPG programmers and operators or administrators with intimate knowledge of the operating system and the applications that run on it is small. This begs the question: How will you manage the platform that supports such a big part of your business? This guide offers strategies and software suggestions to help you plan IT staffing and resources and smooth the transition after your AS/400 talent retires. Read on to learn: