How to execute tests and wait for results?

[neteinstein]

All commands seem to be fire and forget, I'm searching to implement a method to wait for the result within the CI/CD pipeline.

Is there a way to do this?

[kaustubhkp]

any update?

I'm trying to do same thing as mentioned by @neteinstein

I successfully able to use plugin and able to run tests on browser stack via jenkins but not able to display result. any leads much appreciated. btw i'm using espresso framework.

[crothert]

I think we need to use a callback URL
https://www.browserstack.com/docs/app-automate/api-reference/espresso/builds#execute-a-build

[prudhvikrishnadandamudi]

@neteinstein @kaustubhkp
Did you guys able to find a workaround for this?
The commands execute all the four steps and forget.

[crothert]

We send the request then poll browserstack every 45 seconds for completion via python Get Outlook for iOS<https://aka.ms/o0ukef>

…

________________________________ From: prudhvikrishnadandamudi ***@***.***> Sent: Friday, December 16, 2022 1:02:57 PM To: browserstack/browserstack-gradle-plugin ***@***.***> Cc: Cory Rothert ***@***.***>; Comment ***@***.***> Subject: Re: [browserstack/browserstack-gradle-plugin] How to execute tests and wait for results? (Issue #46) @neteinstein<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fneteinstein&data=05%7C01%7Ccrothert%40paypal.com%7Cdf0cf9cb40b043b8386408dadfa8f251%7Cfb00791460204374977e21bac5f3f4c8%7C0%7C0%7C638068213961037730%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2F%2FG%2FruoAttIgla9rZrPZflvqXJE%2F2dHgtP2bhPAszbU%3D&reserved=0> @kaustubhkp<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fkaustubhkp&data=05%7C01%7Ccrothert%40paypal.com%7Cdf0cf9cb40b043b8386408dadfa8f251%7Cfb00791460204374977e21bac5f3f4c8%7C0%7C0%7C638068213961037730%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WNSs%2BoGaFPJPEZYQCDc3wiEk%2F4atK3dU%2BM3iwHh4gNI%3D&reserved=0> Did you guys able to find a workaround for this? The commands execute all the four steps and forget. — Reply to this email directly, view it on GitHub<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fbrowserstack%2Fbrowserstack-gradle-plugin%2Fissues%2F46%23issuecomment-1355603706&data=05%7C01%7Ccrothert%40paypal.com%7Cdf0cf9cb40b043b8386408dadfa8f251%7Cfb00791460204374977e21bac5f3f4c8%7C0%7C0%7C638068213961193952%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=I6cEo%2FkCFuSCPeXbeiffLJJErPXaF0V9J5qc4kzt%2FJE%3D&reserved=0>, or unsubscribe<https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAPZUBDKV2XEH5US35ZWWQW3WNTKIDANCNFSM5PRHVZDQ&data=05%7C01%7Ccrothert%40paypal.com%7Cdf0cf9cb40b043b8386408dadfa8f251%7Cfb00791460204374977e21bac5f3f4c8%7C0%7C0%7C638068213961193952%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=RjYFZ%2BUzyUsAlgPe3kU%2FuzvmthQYT9kIWgKQzz3d4zQ%3D&reserved=0>. You are receiving this because you commented.Message ID: ***@***.***>

[prudhvikrishnadandamudi]

@crothert Thanks for the response
did you use the grade plugin and then send a request to browserstack to check the session status?
What is the request url did you use to the check the status of the session, is this the one (/dashboard/v2/builds/{buildID})
How did you manage to get the buildID to check the specific build status?
Do you have any sample on how you guys managed it?

[praharshithakv]

We suggest the following steps to achieve your requirement to wait until the test suite completes.

Step 1: Create main apk

./gradlew assemble<appVariantName>

Example command:-

./gradlew assembledebug

Step 2: Create test apk

./gradlew assemble<appVariantName>AndroidTest

Example command:-

./gradlew assembledebugAndroidTest

Step 3: Execute browserstackCLIWrapper command with paths replaced(paths for apks created using the above command).

Example command:

./gradlew browserstackCLIWrapper -Pcommand='app-automate espresso run -a /Users/poi/Documents/espresso_latest/app/build/outputs/apk/debug/app-debug.apk -t /Users/poi/Documents/espresso_latest/app/build/outputs/apk/androidTest/debug/app-debug-androidTest.apk -d "Samsung Galaxy S22 Ultra-12.0" --project HubdocAndroidInstrumentation --deviceLogs true '

• -a to mention your main app, -t to mention your test-suite apk, -d to mention the required devices

The above command returns results from which STATUS needs to be extracted and use down the pipeline
Sample Response:

"Build execution in progress, waiting for results"

> Task :app:browserstackCLIWrapper

2023/01/30 14:17:39 Build Summary:
+------------------------------------------+--------------------------+----------+--------+-------------+------+------+------+-------+----------+
|                SESSION ID                |         DEVICES          | DURATION | STATUS | TOTAL TESTS | PASS | FAIL | SKIP | ERROR | TIME OUT |
2023/01/30 14:17:39 Build execution finished. BrowserStack build id (3f34c191cab652e2ad7bf919d2cb125d1936e87b) Build Status: failed
+------------------------------------------+--------------------------+----------+--------+-------------+------+------+------+-------+----------+
| d7b43f7da06f981ee3eb7659ff7876be0f41d3f4 | Samsung Galaxy S22 Ultra |      106 | failed |           9 |    3 |    6 |    0 |     0 |        0 |
+------------------------------------------+--------------------------+----------+--------+-------------+------+------+------+-------+----------+
"Success"

• Please ensure to provide absolute paths for .apk files.
• We support limited set of capabilities with our cli solution, the list is attached to the ticket.