| Peng Huizhong Editor | Produced by He Miao
| CSDN (ID: CSDNnews)
At present, China has entered the new database era of "everyone is a developer, and everyone is a data company" .
html On June 29, Jiang Tao, founder and chairman of CSDN and founding partner of Geek Bang Venture Capital, delivered a keynote speech on " New Database Era " at the Tencent Cloud Database CSDN Engineer Ability Lightweight Certification Conference. He pointed out that in the context of open source devouring the world, databases are also vigorously embracing open source. Different from the traditional relational database , the new database has become a hot topic in the industry and is in urgent need of a large number of relevant talents. Young talents should seize the opportunities and meet the challenges.
CSDN Founder and Chairman, Founding Partner of Geek Bang Venture Capital Jiang Tao
The following is the transcript of Jiang Tao’s speech:
Hello everyone, I am Jiang Tao, the founder of CSDN. I am an programmer with a background in . Databases were a necessary skill for programmers 30 years ago. In recent years, databases have developed greatly. As an investor, I have also invested in Sequoia Database.
CSDN is currently a well-known technology community in China. According to the latest data, the number of CSDN users has exceeded 36 million, and the company's scale is also growing. Today, developers are becoming more and more important. We have established a series of business support systems around developers to help developers gain capabilities and grow. Among them, there is not only a tool development cloud (https://dev.csdn.net) to assist in development, but also a talent cloud to help everyone find a better career. At present, the developer market is getting better and better. I believe that the era of "everyone is a developer and everyone is a technology company" will come soon.
In this context, China wants to build its own core technology ecosystem, and database is the key. Today I will share the "New Database Era" around three parts:
The first is to reveal the current situation of "the big data era we are entering";
The second is to understand the changes in "open source is swallowing up databases";
The third is to grasp " New types of database talents are particularly in demand."
The big era of data
We are in the era of big data, and almost every company is digitally transforming its business. According to statistics, the amount of global data continues to increase every year. The total amount of data generated globally last year was 79ZB, and is expected to reach 180ZB in 2025.
Due to the development of cloud technology , more and more data are stored in the cloud. Data shows that in 2016, only 10% of data was stored in cloud data warehouses, but by 022, this number has grown rapidly to 75%. This shows that with the development of digital economy , every company will As a data company, the database market has also experienced explosive growth.
The history of the database market is actually very long. Starting from the birth of the world's first database system IDS (Integrated Data Storage) in 1964, database development has been almost 60 years today. In the 1980s, databases began to take root in China. Until now, the entire global market has maintained a growth rate of more than 20%. Although the database is an old technology, it contains many new opportunities.
Judging from the financing situation of database technology companies, the numbers are very shocking. In the past 10 years, database companies have raised a total of 8.7 billion in financing, half of which was completed in the past two years. In 2021, the super unicorn big data company Databricks's two rounds of financing totaled US$2.6 billion. It seems that database technology has also entered a new era.
Open source swallowing database
So what is the sign that database technology has entered a new era?
is the "open source swallowing database".
open source has become a must-have for all developers. According to GitHub statistics: only 800,000 people made open source code contributions for the first time in 2016, and 021, this number has grown to 3 million .
In the database field, the "eating" situation of open source is also very obvious.dbdb.io (a global database information database maintained by Carnegie Mellon University) analyzed 841 well-known database systems in the world. Among them, there are 608 open source databases in , accounting for 72% of , and only more than 200 are commercial databases. Open source databases also account for half of the world's top database rankings.
In the 2021 database panorama (V1.0) produced by CSDN, we color-code databases in different fields according to open source and closed source. The light green part on the right is an open source database, and the dark green part on the left is Closed source database. It can be clearly seen that open source is developing rapidly and has a tendency to devour closed source databases.
Source: "New Programmer 002"
China's database has also developed very rapidly under the background of developing core technology ecology. Among the more than 800 database companies in the world counted by dbdb.io (a global database information database maintained by Carnegie Mellon University), there are 56 Chinese companies, but in fact there are more than 200 Chinese database manufacturers. Especially in new databases, Chinese companies are taking the lead. For example, TiDB, which is currently developing strongly, is very active on GitHub.
Of course, developers currently use the relatively traditional basic relational database MySQL, as well as relatively traditional technologies such as Redis, Apache/Hive, and MongoDB in the big data field, but most of them are open source. Although is still the most commonly used relational database, new databases represent the future trend. According to the CSDN 2021-2022 Database Developer Survey, under the cloud trend, 52% of companies have deployed cloud database , and only 23% of companies have not yet planned to deploy cloud databases.
New database talents are in demand
Regarding the current employment environment, I think developers should learn database technology well, and not only learn relational databases, but also new databases. why?
The technology stack of new databases is very different from the past. The relational database is only the most basic part, while many new technology stacks such as data analysis, data warehouse, and visualization are emerging. The more popular new database types in open source include distributed database , time series database , graph database, streaming database, etc., all of which rank very high on GitHub, and the number of stars is also very high.
20 years ago, there were only relational databases on the market, mainly for transactional transactions. But now, thanks to cloud, microservices, distributed applications, global scale, real-time data, deep learning, etc., new database architectures have emerged to solve new performance requirements: different systems for fast reading and fast writing; Systems designed to support real-time analytics; systems for unstructured, semi-structured, transactional, relational, graph, or time series data; suitable for caching, searching, index-based, event-based data, etc… According to statistics, The average enterprise stores data in seven or more different databases.
These new technologies have brought new opportunities and also increased the market demand for talents. The real birth of data engineers in our country was more than ten years ago. Now, as the amount of data increases and more is stored in the cloud, more and more companies have become data companies, and the market demand for data companies continues to grow. data analysis engineers who do analysis based on data are also very important. They must understand both database technology and business in order to better perform data analysis. Such talents will be in high demand in the future.
According to statistics from Glassdoor (an American workplace community that conducts company reviews and job searches), from 2016 to 2020, " data scientist " has been at the top of the list of the best jobs in the United States, and is called the 21st century The sexiest job . Today, the demand for data scientists and data engineers continues to rise, as do salaries.
At present, China's demand for database talents also has the same trend, although in the past it was Oracle's MySQL database that led the field of relational databases. But I believe that China will build its own new database ecosystem in the future.China also has great opportunities to overtake in new technologies, such as Tencent Cloud Database TDSQL and other new databases. At the same time, we also hope that more developers on the CSDN platform can join the new database track, and welcome everyone to participate in competency certification activities.
END
"New Programmer 002: Software-Defined Cars in the New Database Era" was created by more than 60 experts and includes the in-depth thinking of world-class technical masters, the development of cutting-edge technologies, and in-depth industry application practices. The book comes with "2021 Database Panorama V1.0" and "2021 Automotive Technology and Industrial Ecology Panorama V1.0". It also contains "2021 Database Development Research Report" and "2021 Software-Defined Automobile Research Report". Multimedia presentation of graphics, text and video.
Achieve 100 million technical people
