home / github / issues

Menu
  • Search all tables
  • GraphQL API

issues: 333238932

This data as json

id node_id number title user state locked assignee milestone comments created_at updated_at closed_at author_association pull_request body repo type active_lock_reason performed_via_github_app reactions draft state_reason
333238932 MDU6SXNzdWUzMzMyMzg5MzI= 316 datasette inspect takes a very long time on large dbs 132230 closed 0     5 2018-06-18T11:56:27Z 2019-05-11T18:26:25Z 2019-05-11T18:26:25Z NONE  

Hi,

I want to expose data in a very large sqlite database (~600Gb) to the web. I have used datasette with success on smaller test databases with the same schema - it works very well (thanks!). However, using the full db, both datasette inspect and datasette serve seem to hang or pause for a very long time (tens of minutes) on startup. Is this expected behaviour?

(I noticed that the output of datasette inspect includes row counts for each table. Simply counting the rows in this db will take a long time (tens of millions of rows across each of ~10 tables), so I wondered if this is the source of the problem.)

Any help on a workaround would be appreciated.

107914493 issue    
{
    "url": "https://api.github.com/repos/simonw/datasette/issues/316/reactions",
    "total_count": 0,
    "+1": 0,
    "-1": 0,
    "laugh": 0,
    "hooray": 0,
    "confused": 0,
    "heart": 0,
    "rocket": 0,
    "eyes": 0
}
  completed

Links from other tables

  • 0 rows from issues_id in issues_labels
  • 5 rows from issue in issue_comments
Powered by Datasette · Queries took 1.112ms · About: github-to-sqlite