Skip to content

Commit 94f1ff6

Browse files
docs: Add Meltano instructions (#28)
1 parent 4cb599d commit 94f1ff6

12 files changed

+92
-11
lines changed

.gitignore

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,5 @@
11
# Config files
22
*.json
3-
*.yaml
43
!*.example.*
54

65
# Data files

.pre-commit-config.yaml

Lines changed: 26 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,26 @@
1+
ci:
2+
autofix_prs: false
3+
autoupdate_schedule: weekly
4+
autoupdate_commit_msg: 'chore(deps): pre-commit autoupdate'
5+
6+
repos:
7+
- repo: https://github.com/pre-commit/pre-commit-hooks
8+
rev: v4.4.0
9+
hooks:
10+
- id: check-added-large-files
11+
- id: check-json
12+
- id: check-toml
13+
- id: check-yaml
14+
- id: end-of-file-fixer
15+
- id: trailing-whitespace
16+
17+
- repo: https://github.com/pre-commit/pre-commit
18+
rev: v3.0.4
19+
hooks:
20+
- id: validate_manifest
21+
22+
- repo: https://github.com/python-jsonschema/check-jsonschema
23+
rev: 0.21.0
24+
hooks:
25+
- id: check-dependabot
26+
- id: check-github-workflows

README.md

Lines changed: 57 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,63 @@ go build -o target-jsonl-blob
4343

4444
## Usage with Meltano
4545

46-
_TODO_
46+
1. [Download the appropriate asset](#1-download-the-appropriate-asset)
47+
1. [Allow execution of the downloaded binary](#2-allow-execution-of-the-downloaded-binary)
48+
1. [Add a custom Meltano plugin to your project](#3-add-a-custom-meltano-plugin-to-your-project)
49+
1. [Run a pipeline](#4-run-a-pipeline)
50+
51+
### 1. Download the appropriate asset
52+
53+
You can see the full list of assets in the release page: https://github.com/MeltanoLabs/target-jsonl-blob/releases/latest.
54+
55+
The [`gh`](https://cli.github.com/) tool makes downloading an asset easy:
56+
57+
```bash
58+
gh release download v0.0.4 \
59+
-R MeltanoLabs/target-jsonl-blob \
60+
-p '*darwin-amd64' \
61+
--clobber \
62+
-O target-jsonl-blob
63+
```
64+
65+
### 2. Allow execution of the downloaded binary
66+
67+
```bash
68+
chmod +x target-jsonl-blob
69+
```
70+
71+
### 3. Add a custom Meltano plugin to your project
72+
73+
```yaml
74+
# meltano.yml
75+
plugins:
76+
loaders:
77+
- name: target-jsonl-blob
78+
namespace: target_jsonl_blob
79+
executable: ./target-jsonl-blob
80+
settings:
81+
- name: bucket
82+
label: Bucket
83+
description: Target directory (local, S3, Azure Blob)
84+
- name: key_template
85+
label: Key Template
86+
description: Template string for file keys
87+
config:
88+
bucket: file://./output/my-bucket
89+
key_template: $MELTANO_EXTRACTOR_NAMESPACE/{{.StreamName}}.jsonl
90+
```
91+
92+
You also need to ensure the local "bucket" exists:
93+
94+
```bash
95+
mkdir output/my-bucket
96+
```
97+
98+
### 4. Run a pipeline
99+
100+
```bash
101+
meltano run tap-github target-jsonl-blob
102+
```
47103

48104
## Roadmap
49105

cmd/root.go

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ Licensed under the Apache License, Version 2.0 (the "License");
55
you may not use this file except in compliance with the License.
66
You may obtain a copy of the License at
77
8-
http://www.apache.org/licenses/LICENSE-2.0
8+
http://www.apache.org/licenses/LICENSE-2.0
99
1010
Unless required by applicable law or agreed to in writing, software
1111
distributed under the License is distributed on an "AS IS" BASIS,

main.go

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ Licensed under the Apache License, Version 2.0 (the "License");
55
you may not use this file except in compliance with the License.
66
You may obtain a copy of the License at
77
8-
http://www.apache.org/licenses/LICENSE-2.0
8+
http://www.apache.org/licenses/LICENSE-2.0
99
1010
Unless required by applicable law or agreed to in writing, software
1111
distributed under the License is distributed on an "AS IS" BASIS,

target/config.go

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ Licensed under the Apache License, Version 2.0 (the "License");
55
you may not use this file except in compliance with the License.
66
You may obtain a copy of the License at
77
8-
http://www.apache.org/licenses/LICENSE-2.0
8+
http://www.apache.org/licenses/LICENSE-2.0
99
1010
Unless required by applicable law or agreed to in writing, software
1111
distributed under the License is distributed on an "AS IS" BASIS,

target/config_test.go

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ Licensed under the Apache License, Version 2.0 (the "License");
55
you may not use this file except in compliance with the License.
66
You may obtain a copy of the License at
77
8-
http://www.apache.org/licenses/LICENSE-2.0
8+
http://www.apache.org/licenses/LICENSE-2.0
99
1010
Unless required by applicable law or agreed to in writing, software
1111
distributed under the License is distributed on an "AS IS" BASIS,

target/messages.go

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ Licensed under the Apache License, Version 2.0 (the "License");
55
you may not use this file except in compliance with the License.
66
You may obtain a copy of the License at
77
8-
http://www.apache.org/licenses/LICENSE-2.0
8+
http://www.apache.org/licenses/LICENSE-2.0
99
1010
Unless required by applicable law or agreed to in writing, software
1111
distributed under the License is distributed on an "AS IS" BASIS,

target/messages_test.go

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ Licensed under the Apache License, Version 2.0 (the "License");
55
you may not use this file except in compliance with the License.
66
You may obtain a copy of the License at
77
8-
http://www.apache.org/licenses/LICENSE-2.0
8+
http://www.apache.org/licenses/LICENSE-2.0
99
1010
Unless required by applicable law or agreed to in writing, software
1111
distributed under the License is distributed on an "AS IS" BASIS,

target/run.go

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ Licensed under the Apache License, Version 2.0 (the "License");
55
you may not use this file except in compliance with the License.
66
You may obtain a copy of the License at
77
8-
http://www.apache.org/licenses/LICENSE-2.0
8+
http://www.apache.org/licenses/LICENSE-2.0
99
1010
Unless required by applicable law or agreed to in writing, software
1111
distributed under the License is distributed on an "AS IS" BASIS,

0 commit comments

Comments
 (0)