Revisit CI reports

[anpicci]

Impact of the new feature
unit tests, Jenkins

Is your feature request related to a problem? Please describe.
Too many failing unit tests and too many unnecessary pylint messages make the CI reports horrible

Describe the solution you'd like
Tackle failing and unstable unit tests, reduce pylint messages to warnings and errors

Describe alternatives you've considered
Continue generating too long reports

Additional context
None

[d-ylee]

Some more context:
Our pylintrc in standards/.pylintrc might be outdated:

************* Module standards/.pylintrc
E0015 L1: Unrecognized option found: files-output, comment, include-id, enable-basic, max-branchs, min-name-length, bad-functions, enable-imports, enable-variables, enable-classes, ignore-iface-methods, enable-exceptions, enable-format, enable-miscellaneous, enable-metrics (unrecognized-option)

It seems like our .pylintrc was made for pylint~=2.6.0. We are currently using pylint~=2.14.5 in our Jenkins setup.

[d-ylee]

After updating pylint to 3.3.7, this is the report I get with a slightly modified .pylintrc with this command:
pylint --rcfile=standards/.pylintrc -j 2 -f parseable --reports=y --output=pylintreport.out src/python/* test/python/*

Messages
--------

+---------------------------------------+------------+
|message id                             |occurrences |
+=======================================+============+
|consider-using-f-string                |1530926     |
+---------------------------------------+------------+
|invalid-name                           |824371      |
+---------------------------------------+------------+
|disallowed-name                        |720415      |
+---------------------------------------+------------+
|useless-return                         |567956      |
+---------------------------------------+------------+
|missing-function-docstring             |519438      |
+---------------------------------------+------------+
|too-few-public-methods                 |456035      |
+---------------------------------------+------------+
|wrong-import-order                     |361984      |
+---------------------------------------+------------+
|missing-class-docstring                |358482      |
+---------------------------------------+------------+
|unused-argument                        |289682      |
+---------------------------------------+------------+
|broad-exception-caught                 |195391      |
+---------------------------------------+------------+
|wrong-import-position                  |184100      |
+---------------------------------------+------------+
|singleton-comparison                   |161755      |
+---------------------------------------+------------+
|deprecated-method                      |150099      |
+---------------------------------------+------------+
|too-many-positional-arguments          |141673      |
+---------------------------------------+------------+
|no-else-return                         |134902      |
+---------------------------------------+------------+
|fixme                                  |125736      |
+---------------------------------------+------------+
|raise-missing-from                     |116775      |
+---------------------------------------+------------+
|unused-import                          |89036       |
+---------------------------------------+------------+
|unused-variable                        |88479       |
+---------------------------------------+------------+
|unnecessary-pass                       |87593       |
+---------------------------------------+------------+
|anomalous-backslash-in-string          |67253       |
+---------------------------------------+------------+
|undefined-variable                     |63855       |
+---------------------------------------+------------+
|redefined-builtin                      |56720       |
+---------------------------------------+------------+
|too-many-instance-attributes           |56717       |
+---------------------------------------+------------+
|import-outside-toplevel                |54017       |
+---------------------------------------+------------+
|missing-module-docstring               |52824       |
+---------------------------------------+------------+
|consider-using-dict-items              |51639       |
+---------------------------------------+------------+
|use-symbolic-message-instead           |50311       |
+---------------------------------------+------------+
|too-many-arguments                     |49350       |
+---------------------------------------+------------+
|unspecified-encoding                   |47720       |
+---------------------------------------+------------+
|consider-using-with                    |46115       |
+---------------------------------------+------------+
|logging-not-lazy                       |43278       |
+---------------------------------------+------------+
|super-with-arguments                   |41320       |
+---------------------------------------+------------+
|line-too-long                          |37416       |
+---------------------------------------+------------+
|inconsistent-return-statements         |36001       |
+---------------------------------------+------------+
|use-dict-literal                       |35013       |
+---------------------------------------+------------+
|broad-exception-raised                 |34854       |
+---------------------------------------+------------+
|superfluous-parens                     |33866       |
+---------------------------------------+------------+
|trailing-whitespace                    |31675       |
+---------------------------------------+------------+
|too-many-nested-blocks                 |27843       |
+---------------------------------------+------------+
|dangerous-default-value                |27357       |
+---------------------------------------+------------+
|bare-except                            |27328       |
+---------------------------------------+------------+
|no-else-raise                          |24410       |
+---------------------------------------+------------+
|consider-using-from-import             |23342       |
+---------------------------------------+------------+
|unnecessary-dunder-call                |22680       |
+---------------------------------------+------------+
|redundant-u-string-prefix              |18927       |
+---------------------------------------+------------+
|multiple-statements                    |18071       |
+---------------------------------------+------------+
|unnecessary-lambda-assignment          |17769       |
+---------------------------------------+------------+
|consider-using-set-comprehension       |16139       |
+---------------------------------------+------------+
|redefined-outer-name                   |16073       |
+---------------------------------------+------------+
|use-a-generator                        |15599       |
+---------------------------------------+------------+
|too-many-public-methods                |14349       |
+---------------------------------------+------------+
|ungrouped-imports                      |13835       |
+---------------------------------------+------------+
|consider-using-generator               |13576       |
+---------------------------------------+------------+
|possibly-used-before-assignment        |13557       |
+---------------------------------------+------------+
|no-else-continue                       |13313       |
+---------------------------------------+------------+
|expression-not-assigned                |12548       |
+---------------------------------------+------------+
|chained-comparison                     |10634       |
+---------------------------------------+------------+
|trailing-newlines                      |10179       |
+---------------------------------------+------------+
|too-many-locals                        |10090       |
+---------------------------------------+------------+
|consider-using-in                      |9751        |
+---------------------------------------+------------+
|redefined-argument-from-local          |9732        |
+---------------------------------------+------------+
|too-many-statements                    |9632        |
+---------------------------------------+------------+
|use-yield-from                         |9542        |
+---------------------------------------+------------+
|unnecessary-comprehension              |9486        |
+---------------------------------------+------------+
|use-implicit-booleaness-not-len        |9337        |
+---------------------------------------+------------+
|empty-docstring                        |8589        |
+---------------------------------------+------------+
|simplifiable-if-statement              |8383        |
+---------------------------------------+------------+
|too-many-lines                         |8217        |
+---------------------------------------+------------+
|too-many-branches                      |7251        |
+---------------------------------------+------------+
|pointless-string-statement             |7244        |
+---------------------------------------+------------+
|missing-final-newline                  |7201        |
+---------------------------------------+------------+
|keyword-arg-before-vararg              |6296        |
+---------------------------------------+------------+
|simplifiable-if-expression             |5689        |
+---------------------------------------+------------+
|logging-fstring-interpolation          |5221        |
+---------------------------------------+------------+
|unidiomatic-typecheck                  |4973        |
+---------------------------------------+------------+
|eval-used                              |4944        |
+---------------------------------------+------------+
|bad-indentation                        |4476        |
+---------------------------------------+------------+
|multiple-imports                       |3852        |
+---------------------------------------+------------+
|wildcard-import                        |3743        |
+---------------------------------------+------------+
|use-implicit-booleaness-not-comparison |3385        |
+---------------------------------------+------------+
|consider-using-enumerate               |3372        |
+---------------------------------------+------------+
|global-statement                       |3361        |
+---------------------------------------+------------+
|bad-file-encoding                      |3348        |
+---------------------------------------+------------+
|consider-merging-isinstance            |3259        |
+---------------------------------------+------------+
|consider-using-dict-comprehension      |3190        |
+---------------------------------------+------------+
|f-string-without-interpolation         |3178        |
+---------------------------------------+------------+
|used-before-assignment                 |2583        |
+---------------------------------------+------------+
|try-except-raise                       |2547        |
+---------------------------------------+------------+
|consider-iterating-dictionary          |2361        |
+---------------------------------------+------------+
|global-variable-not-assigned           |2106        |
+---------------------------------------+------------+
|unsubscriptable-object                 |1952        |
+---------------------------------------+------------+
|modified-iterating-list                |1920        |
+---------------------------------------+------------+
|unrecognized-option                    |1915        |
+---------------------------------------+------------+
|unreachable                            |1849        |
+---------------------------------------+------------+
|consider-using-max-builtin             |1770        |
+---------------------------------------+------------+
|possibly-unused-variable               |1745        |
+---------------------------------------+------------+
|unbalanced-dict-unpacking              |1718        |
+---------------------------------------+------------+
|no-value-for-parameter                 |1659        |
+---------------------------------------+------------+
|use-maxsplit-arg                       |1550        |
+---------------------------------------+------------+
|invalid-unary-operand-type             |1440        |
+---------------------------------------+------------+
|unnecessary-negation                   |1358        |
+---------------------------------------+------------+
|deprecated-module                      |1240        |
+---------------------------------------+------------+
|no-else-break                          |1146        |
+---------------------------------------+------------+
|too-many-function-args                 |958         |
+---------------------------------------+------------+
|pointless-statement                    |946         |
+---------------------------------------+------------+
|consider-using-join                    |931         |
+---------------------------------------+------------+
|useless-option-value                   |893         |
+---------------------------------------+------------+
|consider-using-min-builtin             |861         |
+---------------------------------------+------------+
|duplicate-code                         |822         |
+---------------------------------------+------------+
|undefined-loop-variable                |819         |
+---------------------------------------+------------+
|reimported                             |797         |
+---------------------------------------+------------+
|consider-using-get                     |757         |
+---------------------------------------+------------+
|pointless-exception-statement          |723         |
+---------------------------------------+------------+
|logging-format-interpolation           |694         |
+---------------------------------------+------------+
|unused-wildcard-import                 |684         |
+---------------------------------------+------------+
|assignment-from-no-return              |684         |
+---------------------------------------+------------+
|condition-evals-to-constant            |679         |
+---------------------------------------+------------+
|not-a-mapping                          |668         |
+---------------------------------------+------------+
|not-callable                           |667         |
+---------------------------------------+------------+
|redundant-unittest-assert              |600         |
+---------------------------------------+------------+
|syntax-error                           |450         |
+---------------------------------------+------------+
|bad-string-format-type                 |444         |
+---------------------------------------+------------+
|use-sequence-for-iteration             |378         |
+---------------------------------------+------------+
|useless-import-alias                   |359         |
+---------------------------------------+------------+
|consider-swap-variables                |349         |
+---------------------------------------+------------+
|consider-using-ternary                 |315         |
+---------------------------------------+------------+
|too-many-format-args                   |287         |
+---------------------------------------+------------+
|use-list-literal                       |284         |
+---------------------------------------+------------+
|simplify-boolean-expression            |276         |
+---------------------------------------+------------+
|misplaced-bare-raise                   |276         |
+---------------------------------------+------------+
|trailing-comma-tuple                   |274         |
+---------------------------------------+------------+
|global-variable-undefined              |247         |
+---------------------------------------+------------+
|invalid-envvar-default                 |211         |
+---------------------------------------+------------+
|global-at-module-level                 |204         |
+---------------------------------------+------------+
|self-assigning-variable                |195         |
+---------------------------------------+------------+
|unnecessary-semicolon                  |193         |
+---------------------------------------+------------+
|unexpected-keyword-arg                 |158         |
+---------------------------------------+------------+
|using-constant-test                    |154         |
+---------------------------------------+------------+
|unnecessary-lambda                     |107         |
+---------------------------------------+------------+
|simplifiable-condition                 |52          |
+---------------------------------------+------------+
|comparison-of-constants                |41          |
+---------------------------------------+------------+
|no-name-in-module                      |15          |
+---------------------------------------+------------+
|comparison-with-itself                 |11          |
+---------------------------------------+------------+




------------------------------------------------------------------
Your code has been rated at 9.50/10 (previous run: 9.50/10, +0.00)

Note that this is for the entire code base. Our Jenkins PR test only runs pylint on changed files.