{"html_url": "https://github.com/dogsheep/healthkit-to-sqlite/issues/7#issuecomment-514496725", "issue_url": "https://api.github.com/repos/dogsheep/healthkit-to-sqlite/issues/7", "id": 514496725, "node_id": "MDEyOklzc3VlQ29tbWVudDUxNDQ5NjcyNQ==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2019-07-24T06:20:59Z", "updated_at": "2019-07-24T06:20:59Z", "author_association": "MEMBER", "body": "I'm using https://pypi.org/project/memory-profiler/ to explore this in more detail:\r\n\r\n```\r\n$ pip install memory-profiler matplotlib\r\n```\r\n\r\nThen:\r\n\r\n```\r\n$ mprof run healthkit-to-sqlite ~/Downloads/healthkit-export.zip healthkit.db\r\n$ mprof plot\r\n```\r\n\r\n<img width=\"1128\" alt=\"Screen Shot 2019-07-24 at 8 17 06 AM\" src=\"https://user-images.githubusercontent.com/9599/61769849-f3294a00-adeb-11e9-9026-02c24209530f.png\">\r\n", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 472097220, "label": "Script uses a lot of RAM"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/healthkit-to-sqlite/issues/7#issuecomment-514498221", "issue_url": "https://api.github.com/repos/dogsheep/healthkit-to-sqlite/issues/7", "id": 514498221, "node_id": "MDEyOklzc3VlQ29tbWVudDUxNDQ5ODIyMQ==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2019-07-24T06:26:49Z", "updated_at": "2019-07-24T06:26:49Z", "author_association": "MEMBER", "body": "Adding `el.clear()` got me a huge improvement:\r\n\r\n<img width=\"1128\" alt=\"Screen Shot 2019-07-24 at 8 23 26 AM\" src=\"https://user-images.githubusercontent.com/9599/61770130-c3c70d00-adec-11e9-886a-93a2cea5bf4b.png\">\r\n", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 472097220, "label": "Script uses a lot of RAM"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/healthkit-to-sqlite/issues/7#issuecomment-514500253", "issue_url": "https://api.github.com/repos/dogsheep/healthkit-to-sqlite/issues/7", "id": 514500253, "node_id": "MDEyOklzc3VlQ29tbWVudDUxNDUwMDI1Mw==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2019-07-24T06:34:28Z", "updated_at": "2019-07-24T06:34:28Z", "author_association": "MEMBER", "body": "Clearing the root element each time saved even more:\r\n\r\n<img width=\"1128\" alt=\"Screen Shot 2019-07-24 at 8 30 38 AM\" src=\"https://user-images.githubusercontent.com/9599/61770555-d3932100-aded-11e9-8ffe-bebd682f94ed.png\">\r\n", "reactions": "{\"total_count\": 2, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 2, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 472097220, "label": "Script uses a lot of RAM"}, "performed_via_github_app": null}
{"html_url": "https://github.com/simonw/sqlite-utils/issues/49#issuecomment-514509307", "issue_url": "https://api.github.com/repos/simonw/sqlite-utils/issues/49", "id": 514509307, "node_id": "MDEyOklzc3VlQ29tbWVudDUxNDUwOTMwNw==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2019-07-24T07:09:43Z", "updated_at": "2019-07-24T07:10:21Z", "author_association": "OWNER", "body": "This syntax should be shared with #42 as much as possible.\r\n\r\nMaybe something based on a namedtuple would work, since those are already used in the library.\r\n\r\n```python\r\nworkouts = db.table(\"workouts\", extracts=[Extract(\r\n    columns=[\"source\", \"source_version\"],\r\n    table=\"Sources\"\r\n)])\r\n```\r\nSince namedtuples cannot have default values this should probably be a class instead. Actually it looks like there is a trick for defaults here: https://stackoverflow.com/a/18348004", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 472115381, "label": "extracts= should support multiple-column extracts"}, "performed_via_github_app": null}
{"html_url": "https://github.com/dogsheep/healthkit-to-sqlite/issues/9#issuecomment-514745798", "issue_url": "https://api.github.com/repos/dogsheep/healthkit-to-sqlite/issues/9", "id": 514745798, "node_id": "MDEyOklzc3VlQ29tbWVudDUxNDc0NTc5OA==", "user": {"value": 166463, "label": "tholo"}, "created_at": "2019-07-24T18:25:36Z", "updated_at": "2019-07-24T18:25:36Z", "author_association": "NONE", "body": "This is on macOS 10.14.6, with Python 3.7.4, packages in the virtual environment:\r\n\r\n```\r\nPackage             Version\r\n------------------- -------\r\naiofiles            0.4.0\r\nClick               7.0\r\nclick-default-group 1.2.1\r\ndatasette           0.29.2\r\nh11                 0.8.1\r\nhealthkit-to-sqlite 0.3.1\r\nhttptools           0.0.13\r\nhupper              1.8.1\r\nimportlib-metadata  0.18\r\nJinja2              2.10.1\r\nMarkupSafe          1.1.1\r\nPint                0.8.1\r\npip                 19.2.1\r\npluggy              0.12.0\r\nsetuptools          41.0.1\r\nsqlite-utils        1.7\r\ntabulate            0.8.3\r\nuvicorn             0.8.4\r\nuvloop              0.12.2\r\nwebsockets          7.0\r\nzipp                0.5.2\r\n```", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 472429048, "label": "Too many SQL variables"}, "performed_via_github_app": null}