Merge branch 'master' into add_tests

uploadCodelist first deletes codelist graph to clear out any previous mistakes

Test for jobDraft.replace() issue. Extend Exception rather than Throwable.

Test for and add cache buster config as part of publish.

Implement Drafter.publishDraftset()

Apache components HttpHost uses -1 as default port for scheme; see if that helps with pre-emptive basic auth.

Use husdon.FilePath() to get file InputStream. May need special handling for remote nodes, see https://stackoverflow.com/questions/41250567/using-filepath-to-access-workspace-on-slave-in-jenkins-pipeline

Start verifying pipeline requests.

Use Apache http components directly in cube import pipeline, with attempt to use FileInputStream for streaming potentially large HTTP requests.

Try implementing with callable global to set things up and compiled class implementing drafter methods. Use test JSON files as responses.

Add configFileProvider and credentials binding plugins, for testing Jenkins stored parameters.

Merge remote-tracking branch 'origin/master' into add_tests

drafter.queryDraft with GET instead of POST

Configure http-request not to throw `hudson.AbortException` on 4XX

Fix query url

Attempt to set Accept as custom header, not using acceptType param

Candidate version of drafter.queryDraftset

Ignore IntelliJ .idea dir

Factor out components and codelists table2qb pipelines.

Add pipeline-utility-steps for readJSON

Add test based on https://github.com/mkobit/jenkins-pipeline-shared-libraries-gradle-plugin. Currently times-out after sending and receiving HTTP req/res.

Ensure data inserted into jobDraft

Delete by path not label

Delete jobDraft only if present

Debugging issue with uploadTidy() not appearing to be called when optional datasetPath argument isn't supplied.

uploadTidy takes optional datasetPath argument ...

Also requires that we delete datasets by path, not label

Improved jobDraft logging

jobDraft.replace Try with finally

Split draft creation and use ...

Requires drafts to be created in the job, not per operation

drafter.findOrCreateDraftset

Skip deleting draftset

Skip filename in self-call

Oh my typo

See if coercion helps groovy find drafter.findDataset ...

java.lang.NoSuchMethodError: No such DSL method 'findDraftset' found among ... globals [..., drafter, ... ]
    ...
    at dataset.delete(/var/jenkins_home/jobs/GSS_data/jobs/Migration/jobs/ONS-Local-Area-Migration-Indicators/builds/44/libs/pmd/vars/dataset.groovy:10)

More findDraftset typos

s/draftset/drafts typo

Extract dataset.delete and draftset.findDraftset

Extract util.slugise()

Output some debug info.

Explicitly check not-null oldLabel. Lowercase old label.

Add type in case it matters.

Add optional 'oldLabel' argument to help ensure previous graphs are removed.

Remove extraneous bracket.

uploadTidy to replace uploadDraftset; use empty dataset label so title isn't overridden in metadata.

ons-table2qb.core/data-cube uses new parameter, 'dataset-slug'

Put columns mapping CSV file in metadata directory so it doesn't interfere with other CSV files.

Use brackets.

Attempt to use updated data-cube pipeline with additional columns-csv parameter.

Add method to upload data cube observations and metadata as turtle/trig respectively.

Dataset metadata uploaded as trig, needs explicit utf-8 encoding.

Add charset=UTF-8 for CSV files.

Revert workaround - issue is that charset=value shouldn't have quotes around value. Add charset=UTF-8 to multipart/form-data as a workaround to force body to be treated as UTF-8 encoded string.

Attempt to workaround odd issue with endpoint parsing URL params differently if a content-type with a charset is supplied.

Add optional 'graph' parameter to addData()

Lower case the dataset path.

Add some logging.

Remove other extraneous parameter.

Remove extraneous parameter.

Avoid unmarshallable things.

Add macros for uploading and publishing draftsets.

Use the right parameter for auth.

Attempt to clear the cache and reindex for search on publishing.

Try to catch the body of 5xx errors while waiting for job completion.

Try calling local method without prefix.

More type coercing.

Be more explicit about types. Sigh.

Add deleteGraph. Fix id param on deleteDraftset.

Initial refactor.