2 thoughts on “At present, what is the development trend of the domestic software test industry?”
Anne
New trend of software testing industry: . Artificial intelligence AI test The use of AI (deep learning, etc.) systems to auxiliary testing work is definitely the most popular test trend in recent years, including testing cases, including test cases, which includes test cases. The automatic generation of test data and test code, analysis of large -scale test results, automated exploration test, defect positioning, etc., the United States has already launched commercial AI testing tools. Although many companies have started to study AI auxiliary testing, there are also many tools, but they all have a big problem: the accuracy is not high enough. Because there are some problems in the AI learning algorithm itself, the accuracy of test cases and verification conditions they learn and produces are not very high. AI auxiliary tests are divided into three steps: 1. Input of automatic production test cases through deep learning models, manual verification output. 2. Automatically produce test cases through deep learning models, and automatically accept the output through the rule model. 3. The input and output of the test case of automatic production models through deep learning models, and automatically verify the output. The first step in the industry can basically achieve the first step. Some companies can already achieve the second step. For the third step, only a small number of large companies have been implemented, and the accuracy is not very high, so AI AI There is still a long way to go. . The test of the new business and architecture system With the emergence and prosperity of the AI system, blockchain, microservice, and big data, special testing will also be a test field in the field of testing fields. trend. Among them, some new challenges will be involved, such as testing the AI system that may use a completely different method and theoretical system as before; how to simulate the real environment when testing the blockchain; In the case, do you need to use a different test strategy and some special test technologies that are different from before; how big data systems simulate real large -scale data in the test environment, and conduct business testing. . Testing infrastructure As the scale of the software system increases, the construction of the test environment becomes more and more complicated, and its cost is getting higher and higher. And in many practical projects, there are some specific needs for the test environment, such as before each round of testing, roll back all the data affected by the last round of testing; Roll back to a certain version before. With the increase of these demand and the increase of cost pressure, the construction of modern and efficient testing infrastructure has become an inevitable trend of a large system. For example, you can use Docker, ANSIBLE, etc. to build efficient testing infrastructure, etc., and then it also has another new name: TestOps. . Testing in the product environment The online faults in both Alibaba Cloud and Tencent Cloud last year. Among them, Alibaba Cloud wrote in the explanation of its online failure on June 27, 2018 : “This function has not occurred in the test environment verification. After the online to the automated operation and maintenance system, an unknown code bug is triggered.” It can be seen that for large -scale and highly complex server systems, only testing the test environment can no longer meet quality needs. How to test in the product environment will definitely occupy an important position in the current and future cloud eras. Essence . Test based on fault injection (Chaos Engineering) As the cloud platform becomes larger and more complicated, it is difficult for ordinary test cases The injected test (Fit-Failure Inject Testing) is also increasingly important. Among them, Netflix uses a large -scale FIT in its product environment, not just in the test environment. Netflix published a number of articles about fault injection testing in its official blog. In the future of cloud systems, more and more complicated times, the test of fault -based injection in the pursuit of quality is definitely essential for a system of quality. 6. Safety development process and automation safety test Now when it comes to safety, it is generally a chat penetration test or safety protection, such as WFA. Few people talk about the safety development and development process. Safety test. In fact, security development is the most effective security protection method. For example, as early as the beginning of this century, Microsoft proposed its own security development process SDL (Security Lifecycle), but because Microsoft’s SDL is very bulky and the cost is also very high, it is very high, which leads to its current current. It is difficult to promote the Internet era that requires agility and rapid development of software. place BSI is a safe development process that combines agile methodology and practice, and needs to embed various types of security tests in the development process, such as security tests based on business functions, white based on threatening modeling structure. Box safety testing, and safety scanning and testing based on various black box automation, is particularly suitable for agile teams that need to be delivered. Seven, measurement analysis and design Now few companies will test and analyze and design the system, and only some large systems of large companies will use it. In fact, the test can be a very old topic, just like the contract test was proposed as early as the 1980s, but because of its low investment in small and medium -sized projects, few companies would use it. Until the emergence and prevalence of large -scale microservices, the contract testing this old antique has gradually become a new hot spot. However, as the scale of software increases, especially when large systems such as cloud platforms become a trend, it will become a trend more effective by improving its testability to make it more effective. . Agile test Agile testing may be in many foreign companies (such as Atlassian, Netflix, Google, etc.) is already normal , but in China, it will still be a kind of future in the future. Hope. Among them, the concepts and practices such as testing forward movement, test -driven development (ATDD of business functional level), and premium defects are better than discovery defects, so that agile testing can effectively reduce defect code and repurchase, thereby effectively saving development costs, increasing delivery speed and delivery speed and delivery speed and delivery speed. Software quality, so various practices in agile testing will definitely become a trend in China.
When the IT industry is in the initial stage of development, because most software is relatively simple and the testing of it is not complicated, it is often a simple test after the development of software development companies. However, after the IT industry has developed to a advanced stage, the system is becoming more and more precise, and software is becoming more and more complicated, and the scope of influence continues to expand. Therefore, the software developed during this period must be tested very strictly. Otherwise, it will not only trigger the decline in sales revenue and the increase in operating costs, but even bring legal responsibility to enterprises. In terms of systems such as finance and telecommunications tendency to nationwide, the risks have affected and have a wide range of industries, the consequences of its business impact are even more unimaginable. Shan Jun, the general manager of the Quality Testing Division of Shenzhou Digital System Integrated Service Co., Ltd., a senior expert in IT service, pointed out that comprehensive and rigorous testing and evaluation are the best practice to reduce the risk of enterprise IT systems. A “time bomb”.
The software in China is currently undergoing quality testing by software development companies. Overall, enterprises attach importance to development and despise testing. Related information shows that the cost of domestic testing does not exceed 5%of the entire project investment (this data includes lower hardware investment, and it is low in some industries). However, in foreign countries, the cost of general testing is very high, reaching about 30%. In fact, the quality problems of many software in recent years have attracted people’s attention, and some problems have even had a huge impact during operation.
Therefore, in addition to the government’s formulation of relevant laws and regulations, more and more enterprises need to be committed to this cause. This will not only bring good reputation, but also bring great profits. Shenzhou Digital System Integration Service Co., Ltd. is exactly the advantages of the risk elements and key points in the construction of IT system construction, and officially proposed the “sharp service” covering the IT life cycle. The quality test service is an important product One of the lines.
In reports from the National Standard and Technology Research Institute, the failure rate of large -scale special software development in the United States is as high as 70%. The US economy loses up to 59.5 billion US dollars each year due to software errors. China’s software market is expected to reach US $ 6.23 billion in 2009, with an average annual growth rate of 18.7%in the next five years. It can be seen that with the continuous expansion of the scale of software, the complexity of software design has continued to increase, more and more opportunities for errors or defects in software development, and customers’ demand for quality testing will become increasingly strong. In addition, the trend of IT management development and operation and maintenance is also promoted to the birth and development of independent test centers.
Shan Jun believes that establishing a large test center is a trend of quality test development. In particular, financial and telecommunications businesses depend on IT stability and depend on serious industries, and establish a separate test center. In response to the in -depth needs of large banks for testing, a set of solutions that they specifically put forward -a large test center solution can help banks to achieve the perfect construction of test centers from the aspects of how to build organizations and how to implement testing. It is reported that the relatively large domestic banks are currently Digital customers in Shenzhou.
quality assessment and quality assurance services are currently in a stage of rapid development. However, compared with foreign countries, domestic users and most manufacturers pay attention to quality testing. Relevant analysts from Soochow Securities said that excellent foreign software development agencies spend 40%of work on software testing, and software testing costs account for 30%to 50%of the total software development costs. Software, test costs are even equivalent to 3 to 5 times that of the entire software project development.
The third -party testing agencies have emerged in China, but many of them are still in the initial stage of development, and industry self -discipline is not enough. How to improve China’s current software testing level is also a problem that needs to be explored. Essence Industry insiders pointed out that improving the development level of China’s software testing industry, the first rush to solve the lack of software testing teams; secondly, we must pay attention to the test force of third parties
New trend of software testing industry:
. Artificial intelligence AI test
The use of AI (deep learning, etc.) systems to auxiliary testing work is definitely the most popular test trend in recent years, including testing cases, including test cases, which includes test cases. The automatic generation of test data and test code, analysis of large -scale test results, automated exploration test, defect positioning, etc., the United States has already launched commercial AI testing tools.
Although many companies have started to study AI auxiliary testing, there are also many tools, but they all have a big problem: the accuracy is not high enough. Because there are some problems in the AI learning algorithm itself, the accuracy of test cases and verification conditions they learn and produces are not very high.
AI auxiliary tests are divided into three steps:
1. Input of automatic production test cases through deep learning models, manual verification output.
2. Automatically produce test cases through deep learning models, and automatically accept the output through the rule model.
3. The input and output of the test case of automatic production models through deep learning models, and automatically verify the output.
The first step in the industry can basically achieve the first step. Some companies can already achieve the second step. For the third step, only a small number of large companies have been implemented, and the accuracy is not very high, so AI AI There is still a long way to go.
. The test of the new business and architecture system
With the emergence and prosperity of the AI system, blockchain, microservice, and big data, special testing will also be a test field in the field of testing fields. trend. Among them, some new challenges will be involved, such as testing the AI system that may use a completely different method and theoretical system as before; how to simulate the real environment when testing the blockchain; In the case, do you need to use a different test strategy and some special test technologies that are different from before; how big data systems simulate real large -scale data in the test environment, and conduct business testing.
. Testing infrastructure
As the scale of the software system increases, the construction of the test environment becomes more and more complicated, and its cost is getting higher and higher. And in many practical projects, there are some specific needs for the test environment, such as before each round of testing, roll back all the data affected by the last round of testing; Roll back to a certain version before. With the increase of these demand and the increase of cost pressure, the construction of modern and efficient testing infrastructure has become an inevitable trend of a large system. For example, you can use Docker, ANSIBLE, etc. to build efficient testing infrastructure, etc., and then it also has another new name: TestOps.
. Testing in the product environment
The online faults in both Alibaba Cloud and Tencent Cloud last year. Among them, Alibaba Cloud wrote in the explanation of its online failure on June 27, 2018 : “This function has not occurred in the test environment verification. After the online to the automated operation and maintenance system, an unknown code bug is triggered.” It can be seen that for large -scale and highly complex server systems, only testing the test environment can no longer meet quality needs. How to test in the product environment will definitely occupy an important position in the current and future cloud eras. Essence
. Test based on fault injection (Chaos Engineering)
As the cloud platform becomes larger and more complicated, it is difficult for ordinary test cases The injected test (Fit-Failure Inject Testing) is also increasingly important. Among them, Netflix uses a large -scale FIT in its product environment, not just in the test environment. Netflix published a number of articles about fault injection testing in its official blog. In the future of cloud systems, more and more complicated times, the test of fault -based injection in the pursuit of quality is definitely essential for a system of quality.
6. Safety development process and automation safety test
Now when it comes to safety, it is generally a chat penetration test or safety protection, such as WFA. Few people talk about the safety development and development process. Safety test. In fact, security development is the most effective security protection method. For example, as early as the beginning of this century, Microsoft proposed its own security development process SDL (Security Lifecycle), but because Microsoft’s SDL is very bulky and the cost is also very high, it is very high, which leads to its current current. It is difficult to promote the Internet era that requires agility and rapid development of software.
place BSI is a safe development process that combines agile methodology and practice, and needs to embed various types of security tests in the development process, such as security tests based on business functions, white based on threatening modeling structure. Box safety testing, and safety scanning and testing based on various black box automation, is particularly suitable for agile teams that need to be delivered.
Seven, measurement analysis and design
Now few companies will test and analyze and design the system, and only some large systems of large companies will use it. In fact, the test can be a very old topic, just like the contract test was proposed as early as the 1980s, but because of its low investment in small and medium -sized projects, few companies would use it. Until the emergence and prevalence of large -scale microservices, the contract testing this old antique has gradually become a new hot spot. However, as the scale of software increases, especially when large systems such as cloud platforms become a trend, it will become a trend more effective by improving its testability to make it more effective.
. Agile test
Agile testing may be in many foreign companies (such as Atlassian, Netflix, Google, etc.) is already normal
, but in China, it will still be a kind of future in the future. Hope. Among them, the concepts and practices such as testing forward movement, test -driven development (ATDD of business functional level), and premium defects are better than discovery defects, so that agile testing can effectively reduce defect code and repurchase, thereby effectively saving development costs, increasing delivery speed and delivery speed and delivery speed and delivery speed. Software quality, so various practices in agile testing will definitely become a trend in China.
When the IT industry is in the initial stage of development, because most software is relatively simple and the testing of it is not complicated, it is often a simple test after the development of software development companies. However, after the IT industry has developed to a advanced stage, the system is becoming more and more precise, and software is becoming more and more complicated, and the scope of influence continues to expand. Therefore, the software developed during this period must be tested very strictly. Otherwise, it will not only trigger the decline in sales revenue and the increase in operating costs, but even bring legal responsibility to enterprises. In terms of systems such as finance and telecommunications tendency to nationwide, the risks have affected and have a wide range of industries, the consequences of its business impact are even more unimaginable. Shan Jun, the general manager of the Quality Testing Division of Shenzhou Digital System Integrated Service Co., Ltd., a senior expert in IT service, pointed out that comprehensive and rigorous testing and evaluation are the best practice to reduce the risk of enterprise IT systems. A “time bomb”.
The software in China is currently undergoing quality testing by software development companies. Overall, enterprises attach importance to development and despise testing. Related information shows that the cost of domestic testing does not exceed 5%of the entire project investment (this data includes lower hardware investment, and it is low in some industries). However, in foreign countries, the cost of general testing is very high, reaching about 30%. In fact, the quality problems of many software in recent years have attracted people’s attention, and some problems have even had a huge impact during operation.
Therefore, in addition to the government’s formulation of relevant laws and regulations, more and more enterprises need to be committed to this cause. This will not only bring good reputation, but also bring great profits. Shenzhou Digital System Integration Service Co., Ltd. is exactly the advantages of the risk elements and key points in the construction of IT system construction, and officially proposed the “sharp service” covering the IT life cycle. The quality test service is an important product One of the lines.
In reports from the National Standard and Technology Research Institute, the failure rate of large -scale special software development in the United States is as high as 70%. The US economy loses up to 59.5 billion US dollars each year due to software errors. China’s software market is expected to reach US $ 6.23 billion in 2009, with an average annual growth rate of 18.7%in the next five years. It can be seen that with the continuous expansion of the scale of software, the complexity of software design has continued to increase, more and more opportunities for errors or defects in software development, and customers’ demand for quality testing will become increasingly strong. In addition, the trend of IT management development and operation and maintenance is also promoted to the birth and development of independent test centers.
Shan Jun believes that establishing a large test center is a trend of quality test development. In particular, financial and telecommunications businesses depend on IT stability and depend on serious industries, and establish a separate test center. In response to the in -depth needs of large banks for testing, a set of solutions that they specifically put forward -a large test center solution can help banks to achieve the perfect construction of test centers from the aspects of how to build organizations and how to implement testing. It is reported that the relatively large domestic banks are currently Digital customers in Shenzhou.
quality assessment and quality assurance services are currently in a stage of rapid development. However, compared with foreign countries, domestic users and most manufacturers pay attention to quality testing. Relevant analysts from Soochow Securities said that excellent foreign software development agencies spend 40%of work on software testing, and software testing costs account for 30%to 50%of the total software development costs. Software, test costs are even equivalent to 3 to 5 times that of the entire software project development.
The third -party testing agencies have emerged in China, but many of them are still in the initial stage of development, and industry self -discipline is not enough. How to improve China’s current software testing level is also a problem that needs to be explored. Essence Industry insiders pointed out that improving the development level of China’s software testing industry, the first rush to solve the lack of software testing teams; secondly, we must pay attention to the test force of third parties