Problem Statement: Automating test scripts is a task that strips away the time of the Test engineer. If a machine can be trained to navigate a website following steps, then the engineer can regain the time spent creating specific scripts for every test.
Another Question
UX/UI: Is it possible to generate a model of a website’s design that ML could consume to be able to navigate that site?
Let’s assume that a machine can be taught to understand the elements of a website. I still have to get it to interact with the website. While thinking about this aspect of my problem, I remember, there was a machine that was taught to play video games. After a quick search on the web, I found TensorKart and started reading. The creator of that system created an input plugin using C, which is really something I don’t want to and probably can’t do efficiently. I am hoping to find some kind of library to bypass that since I’m not talking about something as niche as sending commands to a game console emulator.
Because of my experience with Selenium WebDriver, I thought about it as an interface, but that doesn’t immediately present itself as a workable solution. I don't want to have to create page objects because that's exactly the work I want to give the computer. How to make a computer think it’s receiving input from a mouse and keyboard should not be a difficult problem to overcome, but no experience in this area leaves me with too many unknowns to make any bold statements about how I will accomplish this part of my project.
Research turns up a book in my library that I’ve ignored for a little while: Automate the Boring Stuff by Al Sweigart. In Chapter 18, the intro makes me pretty excited about the potential future of my machine learning automated testing project. Knowing that GUI Automation is a thing (keeping in mind that I knew Selenium WebDriver was a thing), and that there are modules for Python (again proving that Python is a broad language with many applications)...Well, I’m just excited to get started.
I also really need to get more understanding of feeding data into the machine for actual use beyond testing. In the code I copied and ran previously, it prints out the assessment of how the net faired at identifying the test data. There are more levels to testing software than identifying what a piece of data is or is not. In my project, I propose to have a machine that can navigate a web page based on a simple set of instructions a human could follow. I also propose to have that machine assess the condition of the page based on its interactions with it. Finally, it has to decide if that set of interactions and assessments meet a criteria it has been given and report on those assessments. I don’t believe this is impossible, but I am starting to see that this is far more complicated than most of the A.I. projects that sit in the public eye.
Another Question
UX/UI: Is it possible to generate a model of a website’s design that ML could consume to be able to navigate that site?
Let’s assume that a machine can be taught to understand the elements of a website. I still have to get it to interact with the website. While thinking about this aspect of my problem, I remember, there was a machine that was taught to play video games. After a quick search on the web, I found TensorKart and started reading. The creator of that system created an input plugin using C, which is really something I don’t want to and probably can’t do efficiently. I am hoping to find some kind of library to bypass that since I’m not talking about something as niche as sending commands to a game console emulator.
Because of my experience with Selenium WebDriver, I thought about it as an interface, but that doesn’t immediately present itself as a workable solution. I don't want to have to create page objects because that's exactly the work I want to give the computer. How to make a computer think it’s receiving input from a mouse and keyboard should not be a difficult problem to overcome, but no experience in this area leaves me with too many unknowns to make any bold statements about how I will accomplish this part of my project.
Research turns up a book in my library that I’ve ignored for a little while: Automate the Boring Stuff by Al Sweigart. In Chapter 18, the intro makes me pretty excited about the potential future of my machine learning automated testing project. Knowing that GUI Automation is a thing (keeping in mind that I knew Selenium WebDriver was a thing), and that there are modules for Python (again proving that Python is a broad language with many applications)...Well, I’m just excited to get started.
I also really need to get more understanding of feeding data into the machine for actual use beyond testing. In the code I copied and ran previously, it prints out the assessment of how the net faired at identifying the test data. There are more levels to testing software than identifying what a piece of data is or is not. In my project, I propose to have a machine that can navigate a web page based on a simple set of instructions a human could follow. I also propose to have that machine assess the condition of the page based on its interactions with it. Finally, it has to decide if that set of interactions and assessments meet a criteria it has been given and report on those assessments. I don’t believe this is impossible, but I am starting to see that this is far more complicated than most of the A.I. projects that sit in the public eye.
