Changes 14 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275
  1. Revision history for Perl module TestRail::API
  2. 0.050 2021-10-26 TEODESIAN
  3. - Add filtering mechanisms to various API methods, contributed by Matt Spahr
  4. 0.049 2021-08-22 TEODESIAN
  5. - Add getPriorities, getPriorityByName and priorityNamesToIds, contributed by Matt Spahr
  6. 0.048 2021-01-11 TEODESIAN
  7. - Fix issue with getUsers patch in 0.047
  8. 0.047 2020-04-12 TEODESIAN
  9. - Fix getUsers now requiring project ID
  10. - Allow passing TESTRAIL_PLAN_ID env in A::P::P::T
  11. 0.046 2020-05-8 TEODESIAN
  12. - Hide password entry in bin/ utilities.
  13. - Add bin/testrail-replay to re-play the results of runs and plans.
  14. 0.045 2019-05-11 TEODESIAN
  15. - Add getReports and runReport methods to TestRail::API
  16. - Use a cookie jar when doing requests to use testrail sessions if enabled for the API
  17. 0.044 2018-10-9 TEODESIAN
  18. - Add getCaseFields and addCaseField methods to TestRail::API
  19. - Correct argument POD for createRunInPlan
  20. - Add bulkAddResultsByCase
  21. - Fix improper caching by project rather than by testsuite in getSections
  22. - Fix broken repository links
  23. 0.043 2018-06-16 TEODESIAN
  24. - Better error messaging when bad custom result fields are configured in Test::Rail::Parser
  25. 0.042 2018-04-30 TEODESIAN
  26. - Fix uninitialized value warning when no plan (or steps) are emitted
  27. - Die on HTTP 401/403, we likely will never recover from this
  28. - Add ability to re-try failed requests in TestRail::API, App::Prove::Plugin::TestRail and testrail-report
  29. 0.041 2017-06-06 TEODESIAN
  30. - Fix MCE usage issue with confusion based on array -> hash inputs in TestRail::Utils::Find
  31. - Fix issue where Test plans were not recorded in the raw output of a case.
  32. - Add ability to specify a custom status for failures which emit no test plan
  33. - Change tests which emit a plan but no assertions into failures.
  34. - Fix issue where configuration groups in the testrailrc were ignored
  35. 0.040 2017-05-24 TEODESIAN
  36. - Fix performance issue in TestRail::Utils::Find::FindTests
  37. - Fix strange testsuite bug caused by regressions in MCE
  38. - Allow filtering in TestRail::API::getPlans
  39. - Clone refs of cached values so that users can't corrupt it
  40. 0.039 2017-03-07 TEODESIAN
  41. - Fix issue where follow_post_redirect could not be passed to constructor
  42. - Add getRunResults, getRunResultsPaginated Methods in TestRail::API
  43. - Cache connections by default for speedups
  44. - Cache getTests() for getTestByName()
  45. - Fix warnings when testrail-results encounters 'assigned' results
  46. - make --cachefile a multi argument in testrail-results
  47. - add the --perfile argument to testrail-results
  48. - add the --merged argument to testrail-results
  49. - Add platform information and guidance on results_by_version to testrail-results
  50. 0.038 2017-01-23 TEODESIAN
  51. - Optimize TestRail::Utils::Find::getResults and testrail-results
  52. - Add ability to follow POST redirects
  53. - Don't print stack traces during constructor errors, this can leak auth info into logs
  54. - Don't override filename in TAP Parser if we already have it
  55. - Fix issue where non-standard status overrides were not possible
  56. - Add finder callback to TestRail::Utils::FindTests
  57. - Add testsuite_id filter to TestRail::API::getChildRunByName
  58. - Add defect metrics to testrail-results
  59. - Add version metrics to testrail-results
  60. 0.037 2016-08-10 TEODESIAN
  61. - Fix incorrect POD for TestRail::API::createRunInPlan
  62. - Add testrail-results binary and TestRail::Utils::Find::getResults.
  63. - Add TestRail::API::getChildSections, and modify Test::Rail::Parser to recursively search passed sections when spawning runs
  64. - Change TestRail::API::getSections to cache the sections in a project.
  65. - Add notices about problems with duplicate entries to POD.
  66. - Add capability to auto-spawn configurations/groups to App::Prove::Plugin::TestRail and friends when configuration_group is passed
  67. 0.036 2016-04-25 TEODESIAN
  68. - Fix using wrong perl during testsuite when running binaries
  69. - Silence testsuite for easier diagnosis of issues
  70. - Fix warnings due to undef comparison in TestRail::Utils::Find
  71. - Change to using Pod::Usage for help output rather than Pod::Perldoc
  72. 0.035 2016-04-23 TEODESIAN
  73. - Fix testrail-report and testrail-cases broken binary arg passing
  74. - Fix issue where TODO PASS was reported in tests with TODO FAILs.
  75. - Fix issue where TODO FAILED steps were reported as TODO PASS.
  76. - Fix issue where the value of the step_results field was ignored by Test::Rail::Parser
  77. - Fix issue where Test::Rail::Parser would truncate results in non case-per-ok mode
  78. - Remove case_per_ok feature from Test::Rail::Parser, never really worked it turns out
  79. 0.034 2016-02-18 TEODESIAN
  80. - Use Capture::Tiny rahter than IO::CaptureOutput in unit tests
  81. - Allow users to signal Test::Rail::Parser to set a custom status
  82. - Fix issue where todo_pass would be marked even when a bad plan occurred
  83. - Add functions for TestRail 5.2 add/update/remove configurations & groups
  84. - Add bad plan step_result and a comment when not in case_per_ok & bad plan detected
  85. - Add bailout step_result and a comment when not in case_per_ok & bailout detected
  86. 0.033 2016-01-06 TEODESIAN
  87. - Fix issue where running TestRail::Parser with multiple -j in prove corrupted results
  88. - Add timestamps to every step reported for better test bottleneck detection
  89. 0.032 2015-08-31 TEODESIAN
  90. - Fix issue in getCases where arrayref filters were not handled properly
  91. - Add TestRail::API::typeNamesToIds
  92. - Add orphans option to testrail-tests, TestRail::Utils::Find::getTests
  93. - Add TestRail::API::updateCase
  94. - Add new TestRail::Utils::Find functions; getCases, findCases
  95. - Add new script bin/testrail-cases
  96. - Change all binaries into modulinos.
  97. - Resolve issue where testrail-lock would not function
  98. 0.031 2015-08-14 TEODESIAN
  99. - Update getCases to use testRail 4.0 filters, change filter args to HASHREF
  100. - Update TestRail::API::getCaseByName to take filter hashref too
  101. - Update getRunSummary and getPlanSummary to use 'labels' rather than system names
  102. - Add TestRail::API::statusNamesToLabels to ease interaction with above method updates
  103. - Change TestRail::API::translateConfigNamesToIds to accept ARRAY arguments
  104. - Make above function and TestRail::API::sectionNamesToIds return values in correct order
  105. - Change the 'spawn' option in Test::Rail::Parser (and it's callers) to be --testsuite_id
  106. - Add a --testsuite (name) option to Test::Rail::Parser
  107. - Spawning runs will now take run/plan completion status into account, spawning new runs/plans when completion is detected.
  108. - Removed the run_id option from Test::Rail::Parser and it's callers. It isn't really useful in practice, and was not tested.
  109. 0.030 2015-07-31 TEODESIAN
  110. - Fix testrail-tests, was calling function in incorrect namespace
  111. - Fix testrail-bulk-mark-results, was not including library
  112. - Re-instate integration tests for binaries that were removed in 0.029
  113. - Require more up-to-date Pod::Perldoc for help that works on old unices/perls
  114. - Fix windows issue with TestRail::Find
  115. 0.029 2015-07-30 TEODESIAN
  116. - Add bulkAddResults function to TestRail::API
  117. - Add new script testrail-bulk-mark-results and it's backend TestRail::Utils::Results
  118. - Add new script testrail-lock and it's backend TestRail::Utils::Lock
  119. - Re-factor much of the bin/ scripts into TestRail::Utils
  120. - Modify all bin/ scripts to use POD as their help output, move help() to TestRail::Utils
  121. - Modify all bin/ scripts to parse all the ~/.testrailrc options
  122. - Fix an issue where statusNamesToIDs would return status IDs in the wrong order.
  123. - Re-factor to use Type::Tiny parameter checking.
  124. - Fix getCaseTypeByName, it's apparently been broken/noncovered this whole time
  125. - Add options to sort FIFO/LIFO by creation, milestone due date in testrail-runs
  126. - Add TestRail::Utils::Find as a backend to testrail-runs & testrail-tests, expand unit tests
  127. - Move Test::LWP::UserAgent::TestRailMock to t/lib, no need to install it for users
  128. 0.028 2015-06-16 TEODESIAN
  129. - Hotfix: forgot to include a module in the prove plugin. How did this pass compile.t? A mystery.
  130. - Fix an issue where testrail-report incorrectly identified (or failed to identify) the file tested.
  131. - Add character encoding support to TestRail::API and all its callers (default to utf8)
  132. 0.027 2015-06-14 TEODESIAN
  133. - If no tests are run (environment fail), set test status to 'retest' on non case-per-ok tests
  134. - If the only oddities in a test are passing TODO tests, mark entire run as TODO PASS.
  135. - Fix issue where having a ~/.testrailrc would prevent make test from allowing install by cpan client
  136. - Fix issue where specifying sections past the first defined in a project would fail to restrict spawning to said sections
  137. - Add Plan Summarizer function
  138. - Always append the full raw TAP to all results
  139. - Add closePlan and closeRun functions to TestRail::API
  140. - Add option to binaries, plugin to close plan/run if no untested/retest exist at end of TAP parse
  141. 0.026 2015-06-06 TEODESIAN
  142. - Add --no-match option to testrail-tests to find orphan tests in a tree
  143. - Upload full raw results to TestRail when not in step_results or case_per_ok mode
  144. - Add ability to pass section IDs to discriminate when spawning runs in Test::Rail::Parser
  145. - Add ability to pass section names to App::Prove::Plugin::TestRail and testrail-report when spawning runs.
  146. - Add sectionNamesToIds convenience method to TestRail::API
  147. 0.025 2015-05-21 TEODESIAN
  148. - Fix test failures on windows (and an issue in testrail-tests on win32)
  149. - Fix issue where testrail-tests was unresponsive to --help
  150. - Fix issue where getChildRuns would not return all child runs.
  151. 0.024 2015-05-17 TEODESIAN
  152. - Allow spawning of plans in Test::Rail::Parser (and those programs depending on it)
  153. - Fix issue where step_results were not uploaded correctly.
  154. 0.023 2015-05-13 TEODESIAN
  155. - Fix issue where spawning runs in plans with configurations failed.
  156. 0.022 2015-05-08 TEODESIAN
  157. - Fix issue where testrail-tests always attempted to turn test names into paths
  158. 0.021 2015-04-08 TEODESIAN
  159. - Fix issue where getChildRuns did not return anything past first run
  160. - Fix issue where getChildRunByName did not perform configuration filtering correctly
  161. - Add ability to filter by test status and assignedto id to getTests
  162. - Add bin/testrail-tests and bin/testrail-runs
  163. - Add statusNamesToIds and userNamesToIds convenience methods to TestRail::API
  164. - Add getRunSummary to TestRail::API
  165. 0.020 2015-03-25 TEODESIAN
  166. - Add getRunsPaginated and getPlansPaginated to get around 250 hardlimit in TR results
  167. - Modify getRuns and getPlans to use the above to actually get all runs/plans
  168. - Fix various defective pod surrounding those methods
  169. - Fix minor incorrectness in testrail-report POD
  170. 0.019 2015-03-18 TEODESIAN
  171. - Add createRunInPlan method to TestRail::API
  172. - Add translateConfigNamesToIds method to TestRail::API
  173. - Modified getConfigurations, and added GetConfigurationGroups for clarity
  174. - Add ability to spawn runs to App::Prove::TestRail and testrail-report
  175. - Stricter checking that passed configurations passed exist in Test::Rail::Parser
  176. - Require minimum version of JSON::Maybe::XS to resolve smoker failures.
  177. 0.018 2015-01-29 TEODESIAN
  178. - Better finding of $HOME in testrail-report and the prove plugin for cross-platform usage
  179. - Track elapsed time of tests when run as prove plugin, and report this to testrail
  180. 0.017 2015-01-29 TEODESIAN
  181. - Explicitly import List::Util in TestRail::API, this causes issues on some perls
  182. - Require minimum version of Term::ANSIColor
  183. - Fix bad regex for finding filename in testrail_report
  184. 0.016 2015-01-26 TEODESIAN
  185. - Use correct perl when invoking scripts to fix cpantesters failures.
  186. - Use parent instead of base, this confuses older perls
  187. 0.015 2015-01-25 TEODESIAN
  188. - Remove all usage of IO::Capture for more concise verbose test output. Makes cpantesters/travis wig out?
  189. 0.014 2015-01-23 TEODESIAN
  190. - Fixed issue where testrail-report would not parse the results of multiple tests in a TAP file or stream.
  191. - Fixed issue where testrail-report would erroneously attempt to report the results of subtests.
  192. - Parse TODO/SKIP messages correctly, add todo reason to the test notes
  193. - Set SKIP_ALL tests status correctly
  194. - Add TestRail::API::getConfigurations method
  195. - Add TestRail::API::getChildRuns and getChildRunByName methods to extract runs from plans when passed names
  196. - Add ability to pass version to testrail-report & App::Prove::Plugin::TestRail
  197. 0.013 2015-01-04 TEODESIAN
  198. - Remove usage of Types::Serialiser, and use JSON::MaybeXS (odd intermittent errors on testers)
  199. - Remove checking of user being in getUsers, this won't work with external (LDAP) auth
  200. 0.012 2014-12-30 TEODESIAN
  201. - DZIL tidying
  202. - Re-enabled some of the critic tests, fixed a few related issues
  203. - Improve safety of constructor, try to die with helpful messages as soon as possible
  204. - Add class usage checks and test for that as author tests
  205. - Add tests for the server going away, and fix issues encountered therein.
  206. - Add fatal type checking of inputs for all methods, add test to make sure exceptions thrown correctly
  207. - Add offset argument to getTestResults call.
  208. - Add (auto-generated) mock class so we don't have to skip practically all of TestRail-API.t
  209. - Add getTestResultFieldByName method and relevant tests
  210. - Add Test::Rail::Parser and App::Prove::Plugin::TestRail so you can upload results
  211. - Add testrail-report binary for those who want to run on static TAP rather than 'do it live' with prove -P
  212. 0.011 2014-12-04 TEODESIAN
  213. - Converted to using dzil, and testing using TestingMania
  214. - Fixed spelling errors thanks to more extensive testing so enabled
  215. - Started signing the module
  216. 0.010 2014-12-03 TEODESIAN
  217. - Dist name was being set to TestRail::API instead of TestRail-API
  218. - Reformatted this file as per CPAN::Changes::Spec
  219. - Added "use 5.010" to the module, to match min perl in metadata
  220. - Made URL in SEE ALSO a hyperlink with L<...>
  221. - Added link to github repo in pod
  222. 0.009 2014-11-28 TEODESIAN
  223. - Oops, forgot my Test deps
  224. 0.008 2014-11-28 TEODESIAN
  225. - Explicitly include Types::Serialiser, correct some POD issues
  226. 0.007 2014-08-17 TEODESIAN
  227. - 0.002 to this release: More or less the pursuit of Kwalitee
  228. 0.001 2014-07-25 TEODESIAN
  229. - First release to CPAN