{"html_url": "https://github.com/dogsheep/github-to-sqlite/issues/50#issuecomment-693773191", "issue_url": "https://api.github.com/repos/dogsheep/github-to-sqlite/issues/50", "id": 693773191, "node_id": "MDEyOklzc3VlQ29tbWVudDY5Mzc3MzE5MQ==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T02:39:26Z", "updated_at": "2020-09-17T02:39:26Z", "author_association": "MEMBER", "body": "I'm going to start with `github-to-sqlite get` and `github-to-sqlite post` - I may add `put` and suchlike later on.", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 703218756, "label": "Commands for making authenticated API calls"}, "performed_via_github_app": null}
{"html_url": "https://github.com/simonw/datasette/issues/507#issuecomment-693775390", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/507", "id": 693775390, "node_id": "MDEyOklzc3VlQ29tbWVudDY5Mzc3NTM5MA==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T02:47:35Z", "updated_at": "2020-09-17T02:47:35Z", "author_association": "OWNER", "body": "I have a pattern for creating screenshots using Puppeteer running in a GitHub Action now, see https://simonwillison.net/2020/Sep/3/weeknotes-airtable-screenshots-dogsheep/#weeknotes-2020-09-03-social-media-cards-tils", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 455852801, "label": "Every datasette plugin on the ecosystem page should have a screenshot"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/github-to-sqlite/issues/50#issuecomment-693775622", "issue_url": "https://api.github.com/repos/dogsheep/github-to-sqlite/issues/50", "id": 693775622, "node_id": "MDEyOklzc3VlQ29tbWVudDY5Mzc3NTYyMg==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T02:48:34Z", "updated_at": "2020-09-17T02:48:34Z", "author_association": "MEMBER", "body": "I'd like a `--paginate` option that does the same thing as https://github.com/simonw/paginate-json", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 703218756, "label": "Commands for making authenticated API calls"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/github-to-sqlite/issues/50#issuecomment-693788032", "issue_url": "https://api.github.com/repos/dogsheep/github-to-sqlite/issues/50", "id": 693788032, "node_id": "MDEyOklzc3VlQ29tbWVudDY5Mzc4ODAzMg==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T03:35:22Z", "updated_at": "2020-09-17T03:35:22Z", "author_association": "MEMBER", "body": "Documentation: https://github.com/dogsheep/github-to-sqlite/blob/b02bf135485c0a7a3768868967f45a6b5e515289/README.md#making-authenticated-api-calls", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 703218756, "label": "Commands for making authenticated API calls"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/github-to-sqlite/issues/50#issuecomment-693788387", "issue_url": "https://api.github.com/repos/dogsheep/github-to-sqlite/issues/50", "id": 693788387, "node_id": "MDEyOklzc3VlQ29tbWVudDY5Mzc4ODM4Nw==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T03:36:47Z", "updated_at": "2020-09-17T03:36:58Z", "author_association": "MEMBER", "body": "Fun demo of the `--nl` option:\r\n\r\n    github-to-sqlite get /users/simonw/repos --paginate --nl | sqlite-utils insert simonw.db repos - --nl\r\n", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 703218756, "label": "Commands for making authenticated API calls"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/github-to-sqlite/issues/50#issuecomment-693789129", "issue_url": "https://api.github.com/repos/dogsheep/github-to-sqlite/issues/50", "id": 693789129, "node_id": "MDEyOklzc3VlQ29tbWVudDY5Mzc4OTEyOQ==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T03:40:01Z", "updated_at": "2020-09-17T03:40:01Z", "author_association": "MEMBER", "body": "Bug with endpoints that return dictionaries rather than arrays:\r\n```\r\ngithub-to-sqlite get /users/simonw\r\n[\r\n    \"login\",\r\n    \"id\",\r\n    \"node_id\",\r\n    \"avatar_url\",\r\n    \"gravatar_id\",\r\n    \"url\",\r\n    \"html_url\",\r\n    \"followers_url\",\r\n    \"following_url\",\r\n    \"gists_url\",\r\n    \"starred_url\",\r\n    \"subscriptions_url\",\r\n    \"organizations_url\",\r\n    \"repos_url\",\r\n    \"events_url\",\r\n    \"received_events_url\",\r\n    \"type\",\r\n    \"site_admin\",\r\n    \"name\",\r\n    \"company\",\r\n    \"blog\",\r\n    \"location\",\r\n    \"email\",\r\n    \"hireable\",\r\n    \"bio\",\r\n    \"twitter_username\",\r\n    \"public_repos\",\r\n    \"public_gists\",\r\n    \"followers\",\r\n    \"following\",\r\n    \"created_at\",\r\n    \"updated_at\"\r\n]\r\n```", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 703218756, "label": "Commands for making authenticated API calls"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/github-to-sqlite/issues/50#issuecomment-693794700", "issue_url": "https://api.github.com/repos/dogsheep/github-to-sqlite/issues/50", "id": 693794700, "node_id": "MDEyOklzc3VlQ29tbWVudDY5Mzc5NDcwMA==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T04:02:39Z", "updated_at": "2020-09-17T04:02:39Z", "author_association": "MEMBER", "body": "It would be useful if you could pass an `--accept` option to this.", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 703218756, "label": "Commands for making authenticated API calls"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/dogsheep-beta/issues/16#issuecomment-694548909", "issue_url": "https://api.github.com/repos/dogsheep/dogsheep-beta/issues/16", "id": 694548909, "node_id": "MDEyOklzc3VlQ29tbWVudDY5NDU0ODkwOQ==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T23:15:09Z", "updated_at": "2020-09-17T23:15:09Z", "author_association": "MEMBER", "body": "I have sort by date now, #21.", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 694493566, "label": "Timeline view"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/dogsheep-beta/issues/24#issuecomment-694551406", "issue_url": "https://api.github.com/repos/dogsheep/dogsheep-beta/issues/24", "id": 694551406, "node_id": "MDEyOklzc3VlQ29tbWVudDY5NDU1MTQwNg==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T23:22:07Z", "updated_at": "2020-09-17T23:22:07Z", "author_association": "MEMBER", "body": "Neat, I can debug this with the new `--pdb` option:\r\n\r\n    datasette . --get '/-/beta?q=pycon&sort=oldest' --pdb\r\n", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 703970814, "label": "the JSON object must be str, bytes or bytearray, not 'Undefined'"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/dogsheep-beta/issues/24#issuecomment-694551646", "issue_url": "https://api.github.com/repos/dogsheep/dogsheep-beta/issues/24", "id": 694551646, "node_id": "MDEyOklzc3VlQ29tbWVudDY5NDU1MTY0Ng==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T23:22:48Z", "updated_at": "2020-09-17T23:22:48Z", "author_association": "MEMBER", "body": "Looks like its happening in a Jinja fragment template for one of the results:\r\n```\r\n  /Users/simon/Dropbox/Development/dogsheep-beta/dogsheep_beta/__init__.py(169)process_results()\r\n-> output = compiled.render({**result, **{\"json\": json}})\r\n  /Users/simon/.local/share/virtualenvs/dogsheep-beta-u_po4Rpj/lib/python3.8/site-packages/jinja2/asyncsupport.py(71)render()\r\n-> return original_render(self, *args, **kwargs)\r\n  /Users/simon/.local/share/virtualenvs/dogsheep-beta-u_po4Rpj/lib/python3.8/site-packages/jinja2/environment.py(1090)render()\r\n-> self.environment.handle_exception()\r\n  /Users/simon/.local/share/virtualenvs/dogsheep-beta-u_po4Rpj/lib/python3.8/site-packages/jinja2/environment.py(832)handle_exception()\r\n-> reraise(*rewrite_traceback_stack(source=source))\r\n  /Users/simon/.local/share/virtualenvs/dogsheep-beta-u_po4Rpj/lib/python3.8/site-packages/jinja2/_compat.py(28)reraise()\r\n-> raise value.with_traceback(tb)\r\n  <template>(5)top-level template code()\r\n> /usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/json/__init__.py(341)loads()\r\n-> raise TypeError(f'the JSON object must be str, bytes or bytearray, '\r\n```", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 703970814, "label": "the JSON object must be str, bytes or bytearray, not 'Undefined'"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/dogsheep-beta/issues/24#issuecomment-694552393", "issue_url": "https://api.github.com/repos/dogsheep/dogsheep-beta/issues/24", "id": 694552393, "node_id": "MDEyOklzc3VlQ29tbWVudDY5NDU1MjM5Mw==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T23:25:01Z", "updated_at": "2020-09-17T23:25:17Z", "author_association": "MEMBER", "body": "Ran `locals()` In the debugger:\r\n`{'range': <class 'range'>, 'dict': <class 'dict'>, 'lipsum': <function generate_lorem_ipsum at 0x10aeff430>, 'cycler': <class 'jinja2.utils.Cycler'>, 'joiner': <class 'jinja2.utils.Joiner'>, 'namespace': <class 'jinja2.utils.Namespace'>, 'rank': -9.383801886431414, 'rowid': 14297, 'type': 'twitter.db/tweets', 'key': '312658917933076480', 'title': 'Tweet by @chrisstreeter', 'category': 2, 'timestamp': '2013-03-15T20:17:49+00:00', 'search_1': '@simonw are you at pycon? Would love to meet you.', 'display': {'avatar_url': 'https://pbs.twimg.com/profile_images/806275088597204993/38yLHfJi_normal.jpg', 'user_name': 'Chris Streeter', 'screen_name': 'chrisstreeter', 'followers_count': 280, 'tweet_id': 312658917933076480, 'created_at': '2013-03-15T20:17:49+00:00', 'full_text': '@simonw are you at pycon? Would love to meet you.', 'media_urls_2': '[]', 'media_urls': '[]'}, 'json': <module 'json' from '/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/json/__init__.py'>}`", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 703970814, "label": "the JSON object must be str, bytes or bytearray, not 'Undefined'"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/dogsheep-beta/issues/24#issuecomment-694552681", "issue_url": "https://api.github.com/repos/dogsheep/dogsheep-beta/issues/24", "id": 694552681, "node_id": "MDEyOklzc3VlQ29tbWVudDY5NDU1MjY4MQ==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T23:25:54Z", "updated_at": "2020-09-17T23:25:54Z", "author_association": "MEMBER", "body": "This is the template fragment it's rendering:\r\n```html+jinja\r\n            <div style=\"overflow: hidden;\">\r\n              <p>Tweet by <a href=\"https://twitter.com/{{ display.screen_name }}\">@{{ display.screen_name }}</a> ({{ display.user_name }}, {{ \"{:,}\".format(display.followers_count or 0) }} followers)\r\n                on <a href=\"https://twitter.com/{{ display.screen_name }}/status/{{ display.tweet_id }}\">{{ display.created_at }}</a></p>\r\n              </p>\r\n              <blockquote>{{ display.full_text }}</blockquote>\r\n              {% if display.media_urls and json.loads(display.media_urls) %}\r\n                {% for url in json.loads(display.media_urls) %}\r\n                  <img src=\"{{ url }}\" style=\"height: 200px;\">\r\n                {% endfor %}\r\n              {% endif %}\r\n            </div>\r\n```", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 703970814, "label": "the JSON object must be str, bytes or bytearray, not 'Undefined'"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/dogsheep-beta/issues/24#issuecomment-694553579", "issue_url": "https://api.github.com/repos/dogsheep/dogsheep-beta/issues/24", "id": 694553579, "node_id": "MDEyOklzc3VlQ29tbWVudDY5NDU1MzU3OQ==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T23:28:37Z", "updated_at": "2020-09-17T23:28:37Z", "author_association": "MEMBER", "body": "More investigation in pdb:\r\n```\r\n(dogsheep-beta) dogsheep-beta % datasette . --get '/-/beta?q=pycon&sort=oldest' --pdb\r\n> /usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib/python3.8/json/__init__.py(341)loads()\r\n-> raise TypeError(f'the JSON object must be str, bytes or bytearray, '\r\n(Pdb) list\r\n336  \t        if s.startswith('\\ufeff'):\r\n337  \t            raise JSONDecodeError(\"Unexpected UTF-8 BOM (decode using utf-8-sig)\",\r\n338  \t                                  s, 0)\r\n339  \t    else:\r\n340  \t        if not isinstance(s, (bytes, bytearray)):\r\n341  ->\t            raise TypeError(f'the JSON object must be str, bytes or bytearray, '\r\n342  \t                            f'not {s.__class__.__name__}')\r\n343  \t        s = s.decode(detect_encoding(s), 'surrogatepass')\r\n344  \t\r\n345  \t    if \"encoding\" in kw:\r\n346  \t        import warnings\r\n(Pdb) bytes\r\n<class 'bytes'>\r\n(Pdb) locals()['s']\r\nUndefined\r\n(Pdb) type(locals()['s'])\r\n<class 'jinja2.runtime.Undefined'>\r\n```", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 703970814, "label": "the JSON object must be str, bytes or bytearray, not 'Undefined'"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/dogsheep-beta/issues/24#issuecomment-694554584", "issue_url": "https://api.github.com/repos/dogsheep/dogsheep-beta/issues/24", "id": 694554584, "node_id": "MDEyOklzc3VlQ29tbWVudDY5NDU1NDU4NA==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T23:31:25Z", "updated_at": "2020-09-17T23:31:25Z", "author_association": "MEMBER", "body": "I'd prefer it if errors in these template fragments were displayed as errors inline where the fragment should have been inserted, rather than 500ing the whole page - especially since the template fragments are user-provided and could have all kinds of odd errors in them which should be as easy to debug as possible.", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 703970814, "label": "the JSON object must be str, bytes or bytearray, not 'Undefined'"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/dogsheep-beta/issues/24#issuecomment-694557425", "issue_url": "https://api.github.com/repos/dogsheep/dogsheep-beta/issues/24", "id": 694557425, "node_id": "MDEyOklzc3VlQ29tbWVudDY5NDU1NzQyNQ==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-09-17T23:41:01Z", "updated_at": "2020-09-17T23:41:01Z", "author_association": "MEMBER", "body": "I removed all of the `json.loads()` calls and I'm still getting that `Undefined` error.", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 703970814, "label": "the JSON object must be str, bytes or bytearray, not 'Undefined'"}, "performed_via_github_app": null}