Calabash Android Tutorial
The Applitools Eyes Ruby Calabash SDK allows you to easily add visual checkpoints to your Calabash tests. It takes care of getting screenshots of your application, sending them to the Eyes server for validation and failing the test in case differences are found.
Install the SDK
gem install eyes_calabash
Run your first test
Applitools Eyes reports differences by comparing screenshots of your application with baseline images that define the expected appearance of the application at each step of the test. By default, the Eyes SDK detects the environment in which the application is running (namely, the operating system, the type of browser and its viewport size) and compares the screenshots against baseline images that are specific to that environment. The first time you run a test in a given environment, its screenshots will be automatically saved as its baseline. Starting from the second run onward, you always have a baseline to compare against.
The test below is an example taken from a demo project, which you can download from: [calabash-test-android-app] repo(https://github.com/applitools/calabash-test-android-app.).
In order to run the test:
- Checkout the project
- Make sure
ANDROID_HOME
environment variable points to your Android SDK folder - Build the app
- From the command line:
cd path/to/app/home
bundle install
bundle exec calabash-android run ./app/build/outputs/apk/debug/app-debug.apk
It consists of a single visual validation checkpoint, which validates the entire application window. The first time you run this test a new baseline will be created, and subsequent test runs will be compared to this baseline. If any screenshot mismatch its baseline image in a perceptible way, The test will throw a DiffsFoundException
which includes a URL that points to a detailed report where you can see the detected differences and take appropriate actions such as reporting bugs, updating the baseline and more.
Before running the test, make sure to set the API key that identifies your account in the environment variable APPLITOOLS_API_KEY
or directly assign it to the eyes.api_key
property. You can find your API key under the user menu located at the right hand side of the test manager toolbar. If you don't yet have an account create it now to obtain your key.
#The @eyes tag is used to mark scenarios which are eyes tests
@eyes
@eyes_app_name "CalabashSDK(Android)"
Feature: Sample Feature
@eyes_test_name "Check window (with ScrollView)"
Scenario: I check the activity contains ScrollView
When I wait for 1 second
And I press view with id "btn_vert_scroll"
And I wait
Then I check window
2
3
4
5
6
7
8
9
10
11
Analyze your test results
Congratulations! You've successfully run your first visual UI test with Applitools Eyes! A detailed report is ready for your inspection at the Applitools Eyes test manager. Watch this 5 minute video to get acquainted with the test manager and to learn the basics of baseline maintenance.
Login to Applitools and analyze the results.
Learn more
Applitools Eyes is a powerful platform for automated visual UI testing that supports full page screenshots, page layout matching, cross-device and browser testing, test batching, baseline branching and merging, automated baseline maintenance, collaboration features, and much more. Applitools has over 40 SDKs supporting a broad range of testing environments.
Reference documentation
To learn more, check out the Applitools Eyes documentation and tutorials for other testing environments.
Request a demo
If you want to see a demo of all our other features, you do request a demo
Knowledge base and Support
You can search our Knowldege base for more information. You can also file a contact our support team and file a Ticket.
Terms & Conditions Privacy Policy GDPR© 2020 Applitools. All rights reserved.