How to have Code Coverage during Execution [on hold]


How to have Code Coverage during Execution [on hold]



There are tools that allow to view the code coverage of unit tests. However, I can't find tools out there that can record the code coverage of an already deployed application (for black box tests) which is, to be more specific, in Dot Net Core 2.1+. I'm guessing this would be harder or problematic to do, but I'd like to know, in case I missed a tool in the market, what would be the best approach for developing one that can expose an API for the generated data.



UPDATE



I'm adding detailed info as the above is not valid. If the following is not enough or proper, please let me know where I can post my question.



This is related to a higher design level:



SUMMARY



Basically I want to apply an automated TIA (Test Impact Analysis)



CONTEXT



Considering the development Continuous Integration Pipeline for Dotnet core apps, I currently have an automated process of executing automated tests right after deployment in a testing environment. The tests are written in c# using the gauge framework and the type of testing is Browser and API both being black box.



PROBLEM
Tests suites are growing in large numbers, which generates a lot of testing time (hours). As a solution, we are implementing higher infrastructure capacity to host only scripts with the driver and its hub (using zalenium). However, in optimal conditions, a test suite will take longer than needed due to executing a whole test suite (unnecessary test cases) after deployment.



SOLUTION



What I believe would be a good solution is to record the coverage of the steps of a test case against the app code. Therefore, I would be able to tell how much of the black box tests cover of all the app under test code. Consecuently, I want to be able to tell how many TCs I must run regarding a specific commit/pull request. The benefit being I dont have to execute a whole suite of test cases and also avoid having redundant test cases.



NEW PROBLEM



I havent been able to find a tool/library that is able to record an app code coverage by just simply executing it after deployment. All of the tools I have found are for unit testing specifically (in the realm of dotnet core apps).



QUESTION
What would be the best approach for developing a solution from scratch? my question perse would be similar to this one
Code Coverage of a dll file



but in the mentioned question the conext is for c++ apps.



thanks



This question appears to be off-topic. The users who voted to close gave this specific reason:





Please clarify your specific problem or add additional details to highlight exactly what you need. As it's currently written, it’s hard to tell exactly what you're asking. See the stackoverflow.com/help/how-to-ask
– fuzz
Jun 29 at 4:19





Its not hard to do with the right tool; check my bio. API for "the generated data"? What do you want to do with the coverage data?
– Ira Baxter
Jun 29 at 6:58





@fuzz I have modified the question, please let me know if it has proper content
– Morgan Soren
Jun 29 at 21:55




Comments

Post a Comment

Popular posts from this blog

paramiko-expect timeout is happening after executing the command

paramiko-expect timeout is happening after executing the command Can someone help me why timeout is happening after executing the command .I am trying to SSH to a machine and execute a command.I want to store the result of the executed command . I have referred paramiko-timeout but i didn't get my expected result. import traceback try: import paramiko except ImportError: raise Exception("Please install paramiko , pip install paramiko") import pexpect from paramiko_expect import SSHClientInteraction def main(): HOSTNAME = "minion5.net" USERNAME = "root" PASSWORD = "help@432" PROMPT = "root@*:~$s+" try: client = paramiko.SSHClient() client.load_system_host_keys() client.set_missing_host_key_policy(paramiko.AutoAddPolicy()) client.connect(hostname=HOSTNAME, username=USERNAME, password=PASSWORD) with SSHClientInteraction(client, timeout=20, display=True) as interact: ...
Read more

Opening a url is failing in Swift

Opening a url is failing in Swift breakpointing inside the callback and logging success shows false. I added itms-apps to my plist: LSApplicationQueriesSchemes and put this in my app delegate: func application(_ app: UIApplication, open url: URL, options: [UIApplicationOpenURLOptionsKey : Any] = [:]) -> Bool { return true } func moreTapped() { let url = NSURL(string: "itms-apps://itunes.com/developer/quantum-productions/id979315877") if #available(iOS 10.0, *) { UIApplication.shared.open(url! as URL, options: [:], completionHandler: {(success: Bool) in }) } else { UIApplication.shared.openURL(url! as URL) } } Are you testing on a real device? – rmaddy Jun 21 at 23:57 I try on a device, get "Cannot Connect to App Store". Device is online ...
Read more

Export result set on Dbeaver to CSV

Export result set on Dbeaver to CSV Normally I use Dbeaver for windows and always export my result set like this: run my query --> select the result --> export the result set --> select export to clipboard --> done This step by step puts my result set in my clipboard and I can paste it wherever I want to work with it. The problem is that now I am using dbeaver for mac and this guide is not working. I can go on until the moment that I select my result set like in the image below: exporting data set But once I go further in the process, in the last step I get: no query Note that in "source" it was suppose to show the query that originated the result set, but instead it says just "select. As a result it does't select my result or anything (besides being "successful"). Normally my query would show up there automatically and I couldn't find any option that corrects this problem in the menus. Please help me! Thanks. Aft...
Read more