Old Metric from securinbench

README.md

@@ -60,41 +60,39 @@ This project use some of the [FlowDroid](https://github.com/secure-software-engi
 
 
 ### Flowdroid
-~~TTests failed: 34, passed: 64, ignored: 6 of 104 test~~T
-
-Tests failed: 40, passed: 64, ignored: 0 of 104 test
-Tests failed: 33, passed: 71, ignored: 0 of 104 test (original)
-
-Tests failed: +17.5%, passed: +9.86, ignored: 0 of 104 test (original)
-
-#### AliasingTest
-Tests failed: 0, passed: 5, ignored: 1 of 6 test
-#### ArraysTest
-Tests failed: 9, passed: 1, ignored: 0 of 10 test
-#### BasicTest
-Tests failed: 0, passed: 37, ignored: 5 of 42 test
-
-Fails:
-17
-36 (same)
-38
-42
-
-#### CollectionTest 
-Tests failed: 14, passed: 1, ignored: 0 of 15 test
-#### DataStructureTest ☑
-Tests failed: 1, passed: 5, ignored: 0 of 6 test
-#### FactoryTest ☑
-Tests failed: 1, passed: 2, ignored: 0 of 3 test
-#### InterTest
-Tests failed: 7, passed: 7, ignored: 0 of 14 test
-~~#### PredTest~~
-~~Tests failed: 3, passed: 6, ignored: 0 of 9 test~~
-~~#### ReflectionTest~~
-~~Tests failed: 4, passed: 0, ignored: 0 of 4 test~~
-~~#### SanitizerTest~~
-~~Tests failed: 2, passed: 4, ignored: 0 of 6 test~~
-#### SessionTest ☑
-Tests failed: 3, passed: 0, ignored: 0 of 3 test
-#### StrongUpdateTest ☑
-Tests failed: 1, passed: 4, ignored: 0 of 5 test 
+
+## TEST METRICS
+
+> failed: 0, passed: 61, ignored: 42 of 103 tests.
+
+|      Test       |    Σ    |   TP   | FP |
+|:---------------:|:-------:|:------:|:--:|
+|    Aliasing     |   5/6   | 10/11  | 0  |   
+|      Array      |  1/10   |  0/9   | 0  | 
+|      Basic      |  35/42  | 56/61  | 2  |  
+|   Collection    |  2/14   |  2/14  | 1  |
+|  DataStructure  |   4/6   |  5/5   | 2  | 
+|     Factory     |   2/3   |  3/3   | 1  |  
+|      Inter      |  8/14   | 10/16  | 0  | 
+|    ~~Pred~~     | ~~0/9~~ |   -    | -  |
+| ~~Reflection~~  | ~~0/4~~ |   -    | -  |
+| ~~Sanitizers~~  | ~~0/6~~ |   -    | -  |
+|     Session     |   0/3   |  0/3   | 0  | 
+|  StrongUpdate   |   4/5   |  0/1   | 0  |
+|    **TOTAL**    | 61/103  | 86/123 | 6  |
+
+- **Precision:** 0.93
+- **Recall:** 0.70
+- **F-score:** 0.80
+- **Pass Rate:** 59.22%
+
+To have detailed information about each group of tests run, [see here.](old-metrics)
+
+**OBSERVATIONS**
+- Flowdroid is not taking in count the TP expected in StrongUpdate4;
+- Test Basic40 is commented in the test suite so the amount of TP differs from the original run by Flowdroid; 
+- There are two flaky tests: Basic6 and Inter11.
+
+
+## DISCLAIMER
+- The last code changes for this Release were added in March, 2023.

build.sbt

@@ -3,7 +3,7 @@ scalaVersion := "2.12.8"
 name := "svfa-scala"
 organization := "br.unb.cic"
 
-version := "0.2.1-SNAPSHOT"
+version := "0.2.9"
 
 githubOwner := "rbonifacio"
 githubRepository := "svfa-scala"

src/test/java/securibench/micro/datastructures/Datastructures4.java

@@ -16,7 +16,7 @@
 
 /** 
  *  @servlet description="simple nexted data (false positive)" 
- *  @servlet vuln_count = "1" 
+ *  @servlet vuln_count = "0" 
  *  */
 public class Datastructures4 extends BasicTestCase implements MicroTestCase {
     public class C {
@@ -50,6 +50,6 @@ public String getDescription() {
     }
 
     public int getVulnerabilityCount() {
-        return 1;
+        return 0;
     }
 }

src/test/java/securibench/micro/inter/Inter9.java

@@ -51,6 +51,6 @@ public String getDescription() {
     }
 
     public int getVulnerabilityCount() {
-        return 1;
+        return 2;
     }
 }