{"html_url": "https://github.com/simonw/datasette/issues/1098#issuecomment-735444698", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1098", "id": 735444698, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTQ0NDY5OA==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T19:50:14Z", "updated_at": "2020-11-29T19:50:14Z", "author_association": "OWNER", "body": "Demo of the fix: https://latest.datasette.io/fixtures/foreign_key_references (the compound foreign key columns do not link to anything)", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 743370900, "label": "Foreign key links break for compound foreign keys"}, "performed_via_github_app": null} {"html_url": "https://github.com/dogsheep/github-to-sqlite/issues/54#issuecomment-735465708", "issue_url": "https://api.github.com/repos/dogsheep/github-to-sqlite/issues/54", "id": 735465708, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTQ2NTcwOA==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T22:08:46Z", "updated_at": "2020-11-29T22:08:46Z", "author_association": "MEMBER", "body": "Demo:\r\n- https://github-to-sqlite.dogsheep.net/github/steps?_facet=repo\r\n- https://github-to-sqlite.dogsheep.net/github/workflows\r\n- https://github-to-sqlite.dogsheep.net/github/jobs", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 753026003, "label": "github-to-sqlite workflows command"}, "performed_via_github_app": null} {"html_url": "https://github.com/simonw/datasette/issues/1114#issuecomment-735443626", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1114", "id": 735443626, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTQ0MzYyNg==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T19:40:49Z", "updated_at": "2020-11-29T19:40:49Z", "author_association": "OWNER", "body": "Fix is out in 0.52.1: https://docs.datasette.io/en/latest/changelog.html#v0-52-1", "reactions": "{\"total_count\": 1, \"+1\": 1, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 752966476, "label": "--load-extension=spatialite not working with datasetteproject/datasette docker image"}, "performed_via_github_app": null} {"html_url": "https://github.com/simonw/datasette/issues/1098#issuecomment-735443654", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1098", "id": 735443654, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTQ0MzY1NA==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T19:41:01Z", "updated_at": "2020-11-29T19:41:01Z", "author_association": "OWNER", "body": "Fix is out in 0.52.1: https://docs.datasette.io/en/latest/changelog.html#v0-52-1", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 743370900, "label": "Foreign key links break for compound foreign keys"}, "performed_via_github_app": null} {"html_url": "https://github.com/simonw/datasette/issues/1098#issuecomment-735442226", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1098", "id": 735442226, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTQ0MjIyNg==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T19:28:04Z", "updated_at": "2020-11-29T19:28:04Z", "author_association": "OWNER", "body": "For the moment I'm going to solve this by teaching Datasette's internal introspection methods - in particular these ones - to ignore compound foreign keys entirely:\r\n\r\nhttps://github.com/simonw/datasette/blob/e800ffcf7cc6a915eb554b369c654f87162575e5/datasette/utils/__init__.py#L470-L505", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 743370900, "label": "Foreign key links break for compound foreign keys"}, "performed_via_github_app": null} {"html_url": "https://github.com/dogsheep/github-to-sqlite/issues/54#issuecomment-735464438", "issue_url": "https://api.github.com/repos/dogsheep/github-to-sqlite/issues/54", "id": 735464438, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTQ2NDQzOA==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T21:57:08Z", "updated_at": "2020-11-29T21:57:08Z", "author_association": "MEMBER", "body": "Inspired by this tweet from Michael Heap https://twitter.com/mheap/status/1333108608817631238", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 753026003, "label": "github-to-sqlite workflows command"}, "performed_via_github_app": null} {"html_url": "https://github.com/simonw/datasette/issues/1102#issuecomment-735356882", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1102", "id": 735356882, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTM1Njg4Mg==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T07:47:22Z", "updated_at": "2020-11-29T07:47:22Z", "author_association": "OWNER", "body": "Live: https://docs.datasette.io/en/latest/testing_plugins.html", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 749289611, "label": "Plugin testing docs should show datasette.client"}, "performed_via_github_app": null} {"html_url": "https://github.com/simonw/datasette/issues/1099#issuecomment-735444858", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1099", "id": 735444858, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTQ0NDg1OA==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T19:51:58Z", "updated_at": "2020-11-29T19:51:58Z", "author_association": "OWNER", "body": "My fix in deb0be4ae56f191f121239b29e83dd53b62d6305 for #1098 was to have Datasette deliberately pretend that compound foreign keys don't exist: https://github.com/simonw/datasette/blob/deb0be4ae56f191f121239b29e83dd53b62d6305/datasette/utils/__init__.py#L470-L495\r\n\r\nThis workaround will need to be rethought to implement real support for them.", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 743371103, "label": "Support linking to compound foreign keys"}, "performed_via_github_app": null} {"html_url": "https://github.com/simonw/datasette/issues/1114#issuecomment-735436014", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1114", "id": 735436014, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTQzNjAxNA==", "user": {"value": 2182, "label": "danp"}, "created_at": "2020-11-29T18:33:30Z", "updated_at": "2020-11-29T18:33:30Z", "author_association": "CONTRIBUTOR", "body": "Thank you!", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 752966476, "label": "--load-extension=spatialite not working with datasetteproject/datasette docker image"}, "performed_via_github_app": null} {"html_url": "https://github.com/simonw/datasette/issues/1114#issuecomment-735447635", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1114", "id": 735447635, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTQ0NzYzNQ==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T20:16:32Z", "updated_at": "2020-11-29T20:17:11Z", "author_association": "OWNER", "body": "The new Docker container is pushed to Docker Hub too. Here's it in action:\r\n\r\n```\r\n% docker pull datasetteproject/datasette\r\n% docker run --rm -p 8001:8001 -v `pwd`:/mnt datasetteproject/datasette datasette --version\r\ndatasette, version 0.52.1\r\n% docker run --rm -p 8001:8001 -v `pwd`:/mnt datasetteproject/datasette datasette -p 8001 -h 0.0.0.0 /mnt/nps-spatialite.db --load-extension=spatialite\r\nINFO: Started server process [1]\r\nINFO: Waiting for application startup.\r\nINFO: Application startup complete.\r\nINFO: Uvicorn running on http://0.0.0.0:8001 (Press CTRL+C to quit)\r\n```", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 752966476, "label": "--load-extension=spatialite not working with datasetteproject/datasette docker image"}, "performed_via_github_app": null} {"html_url": "https://github.com/simonw/datasette/issues/1114#issuecomment-735429041", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1114", "id": 735429041, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTQyOTA0MQ==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T17:36:18Z", "updated_at": "2020-11-29T17:36:18Z", "author_association": "OWNER", "body": "This is a great catch, thanks.", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 752966476, "label": "--load-extension=spatialite not working with datasetteproject/datasette docker image"}, "performed_via_github_app": null} {"html_url": "https://github.com/simonw/datasette/issues/1111#issuecomment-735320736", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1111", "id": 735320736, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTMyMDczNg==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T02:46:23Z", "updated_at": "2020-11-29T02:46:23Z", "author_association": "OWNER", "body": "This is a really useful bug report, thanks! I agree: more aggressive timeouts on table counts sounds like the right solution here.\r\n\r\nI've learned that avoiding `count(*)` is crucial for handling these larger databases. Datasette has been getting better about that over time but there are still some edge-cases.", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 751195017, "label": "Accessing a database's `.json` is slow for very large SQLite files"}, "performed_via_github_app": null} {"html_url": "https://github.com/simonw/datasette/issues/123#issuecomment-735440555", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/123", "id": 735440555, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTQ0MDU1NQ==", "user": {"value": 11912854, "label": "jsancho-gpl"}, "created_at": "2020-11-29T19:12:30Z", "updated_at": "2020-11-29T19:12:30Z", "author_association": "NONE", "body": "[datasette-connectors](https://github.com/pytables/datasette-connectors) provides an API for making connectors for any file based database. For example, [datasette-pytables](https://github.com/pytables/datasette-pytables) is a connector for HDF5 files, so now is possible to use this type of files with Datasette.\r\n\r\nIt'd be nice if Datasette coud provide that API directly, for other file formats and for urls too.", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 275125561, "label": "Datasette serve should accept paths/URLs to CSVs and other file formats"}, "performed_via_github_app": null} {"html_url": "https://github.com/dogsheep/github-to-sqlite/issues/54#issuecomment-735464493", "issue_url": "https://api.github.com/repos/dogsheep/github-to-sqlite/issues/54", "id": 735464493, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTQ2NDQ5Mw==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T21:57:32Z", "updated_at": "2020-11-29T21:57:32Z", "author_association": "MEMBER", "body": "`$ github-to-sqlite workflows github.db simonw/datasette dogsheep/github-to-sqlite`", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 753026003, "label": "github-to-sqlite workflows command"}, "performed_via_github_app": null} {"html_url": "https://github.com/simonw/datasette/issues/1115#issuecomment-735447198", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1115", "id": 735447198, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTQ0NzE5OA==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T20:12:49Z", "updated_at": "2020-11-29T20:12:49Z", "author_association": "OWNER", "body": "```\r\n$ datasette ../shapefile-to-sqlite/nps-spatialite.db\r\nUsage: datasette serve [OPTIONS] [FILES]...\r\n\r\nError: It looks like you're trying to load a SpatiaLite database without first loading the SpatiaLite module.\r\n\r\nTry adding the --load-extension=spatialite option.\r\n\r\nRead more: https://docs.datasette.io/en/stable/spatialite.html\r\n```", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 752995227, "label": "SpatiaLite error could suggest --load-extension=spatialite"}, "performed_via_github_app": null} {"html_url": "https://github.com/simonw/datasette/issues/1108#issuecomment-735320499", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1108", "id": 735320499, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTMyMDQ5OQ==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T02:42:42Z", "updated_at": "2020-11-29T02:42:42Z", "author_association": "OWNER", "body": "https://docs.datasette.io/en/stable/config.html now redirects correctly.", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 750087350, "label": "Configure /en/stable/config.html redirect when I ship 0.52"}, "performed_via_github_app": null}