{"html_url": "https://github.com/simonw/datasette/issues/1111#issuecomment-754184287", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1111", "id": 754184287, "node_id": "MDEyOklzc3VlQ29tbWVudDc1NDE4NDI4Nw==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2021-01-04T19:57:53Z", "updated_at": "2021-01-04T19:57:53Z", "author_association": "OWNER", "body": "Relevant new feature in sqlite-utils: the ability to use triggers to maintain fast counts. This optimization could help a lot here. https://github.com/simonw/sqlite-utils/issues/212", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 751195017, "label": "Accessing a database's `.json` is slow for very large SQLite files"}, "performed_via_github_app": null}
{"html_url": "https://github.com/simonw/datasette/issues/1111#issuecomment-736322290", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1111", "id": 736322290, "node_id": "MDEyOklzc3VlQ29tbWVudDczNjMyMjI5MA==", "user": {"value": 3243482, "label": "abdusco"}, "created_at": "2020-12-01T08:54:47Z", "updated_at": "2020-12-01T08:54:47Z", "author_association": "CONTRIBUTOR", "body": "Somewhat related: https://github.com/simonw/datasette/issues/859\r\nI fixed the issue with forking and disabling the counts for hidden tables.", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 751195017, "label": "Accessing a database's `.json` is slow for very large SQLite files"}, "performed_via_github_app": null}
{"html_url": "https://github.com/simonw/datasette/issues/1111#issuecomment-735320736", "issue_url": "https://api.github.com/repos/simonw/datasette/issues/1111", "id": 735320736, "node_id": "MDEyOklzc3VlQ29tbWVudDczNTMyMDczNg==", "user": {"value": 9599, "label": "simonw"}, "created_at": "2020-11-29T02:46:23Z", "updated_at": "2020-11-29T02:46:23Z", "author_association": "OWNER", "body": "This is a really useful bug report, thanks! I agree: more aggressive timeouts on table counts sounds like the right solution here.\r\n\r\nI've learned that avoiding `count(*)` is crucial for handling these larger databases. Datasette has been getting better about that over time but there are still some edge-cases.", "reactions": "{\"total_count\": 0, \"+1\": 0, \"-1\": 0, \"laugh\": 0, \"hooray\": 0, \"confused\": 0, \"heart\": 0, \"rocket\": 0, \"eyes\": 0}", "issue": {"value": 751195017, "label": "Accessing a database's `.json` is slow for very large SQLite files"}, "performed_via_github_app": null}