Testomatio - Test Management for Codeception
The idea behind testing is not new. You can’t sleep well if you are not confident that your latest commit didn’t take down the entire application. Having your application covered with tests gives you more trust in the stability of your application. That’s all.
In most cases tests don’t guarantee that the application works 100% as it is supposed to. You can’t predict all possible scenarios and exceptional situations for complex apps, but with tests you can cover the most important parts of your app and at least be sure they work as predicted.
There are plenty of ways to test your application. The most popular paradigm is Unit Testing. For web applications, testing just the controller and/or the model doesn’t prove that your application is working. To test the behavior of your application as a whole, you should write functional or acceptance tests.
Codeception supports all three testing types. Out of the box you have tools for writing unit, functional, and acceptance tests in a unified framework.
|Unit Tests||Functional Tests||Acceptance Tests|
|Scope of the test||Single PHP class||PHP Framework (Routing, Controllers, etc.)||Page in browser (Chrome, Firefox, or PhpBrowser)|
|Testing computer needs access to project’s PHP files||Yes||Yes||No|
|Additional software required||None||None||Selenium for browser testing|
One of the main advantages of Codeception is that you don’t have to decide on just one type of testing. You should have all three! And chances are, that you will (sooner or later) need all three. That’s why Codeception consists of three so-called “suites”: A “unit suite” for all unit tests, a “functional suite” for all functional tests, and an “acceptance suite” for all acceptance tests.
Let’s review those three testing types in reverse order.
How does your client, manager, tester, or any other non-technical person know your website is working? By opening the browser, accessing the site, clicking on links, filling in the forms, and actually seeing the content on a web page. They have no idea of the programming language, framework, database, web-server, or why the application did (or did not) behave as expected.
This is what acceptance tests are doing. They cover scenarios from a user’s perspective. With acceptance tests, you can be confident that users, following all the defined scenarios, won’t get errors.
Any website can be covered with acceptance tests, even if you use a very exotic CMS or framework.
What if you could check our application without running it on a server? That way you could see detailed exceptions on errors, have our tests run faster, and check the database against predictable and expected results. That’s what functional tests are for.
For functional tests, you emulate a web request (
$_POST variables) which returns the HTML response. Inside a test, you can make assertions about the response, and you can check if the data was successfully stored in the database.
For functional tests, your application needs to be structured in order to run in a test environment. Codeception provides connectors to all popular PHP frameworks.
This looks very similar to acceptance tests. The behavior is the same, however, the test is executed inside PHP without launching a browser.
Testing pieces of code before coupling them together is highly important as well. This way, you can be sure that some deeply hidden feature still works, even if it was not covered by functional or acceptance tests. This also shows care in producing stable and testable code.
Codeception is created on top of PHPUnit. If you have experience writing unit tests with PHPUnit you can continue doing so. Codeception has no problem executing standard PHPUnit tests, but, additionally, Codeception provides some well-built tools to make your unit tests simpler and cleaner.
Requirements and code can change rapidly, and unit tests should be updated every time to fit the requirements. The better you understand the testing scenario, the faster you can update it for new behavior.
The Codeception framework was developed to actually make testing fun. It allows writing unit, functional, integration, and acceptance tests in a single, coherent style.
All Codeception tests are written in a descriptive manner. Just by looking at the test body, you can clearly understand what is being tested and how it is performed.