github
html_url | issue_url | id | node_id | user | created_at | updated_at | author_association | body | reactions | issue | performed_via_github_app |
---|---|---|---|---|---|---|---|---|---|---|---|
https://github.com/simonw/datasette/issues/266#issuecomment-389570841 | https://api.github.com/repos/simonw/datasette/issues/266 | 389570841 | MDEyOklzc3VlQ29tbWVudDM4OTU3MDg0MQ== | 9599 | 2018-05-16T15:54:49Z | 2018-06-15T07:41:09Z | OWNER | At the most basic level, this will work based on an extension. Most places you currently put a `.json` extension should also allow a `.csv` extension. By default this will return the exact results you see on the current page (default max will remain 1000). ## Streaming all records Where things get interested is *streaming mode*. This will be an option which returns ALL matching records as a streaming CSV file, even if that ends up being millions of records. I think the best way to build this will be on top of the existing mechanism used to efficiently implement keyset pagination via `_next=` tokens. ## Expanding foreign keys For tables with foreign key references it would be useful if the CSV format could expand those references to include the labels from `label_column` - maybe via an additional `?_expand=1` option. When expanding each foreign key column will be shown twice: rowid,city_id,city_id_label,state | { "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
323681589 | |
https://github.com/simonw/datasette/issues/266#issuecomment-397534196 | https://api.github.com/repos/simonw/datasette/issues/266 | 397534196 | MDEyOklzc3VlQ29tbWVudDM5NzUzNDE5Ng== | 9599 | 2018-06-15T07:12:16Z | 2018-06-15T07:12:16Z | OWNER | The first version of this is now shipped to master. I ended up rewriting most of the experimental branch to deal with the nasty issue described in #303 Demo is available on https://fivethirtyeight.datasettes.com/fivethirtyeight-ab24e01/most-common-name%2Fsurnames ![2018-06-15 at 12 11 am](https://user-images.githubusercontent.com/9599/41455090-bd5ece30-7030-11e8-8da4-11fbb1f2ef8b.png) Here's the CSV version of that page: https://fivethirtyeight.datasettes.com/fivethirtyeight-ab24e01/most-common-name%2Fsurnames.csv | { "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
323681589 | |
https://github.com/simonw/datasette/issues/266#issuecomment-397534404 | https://api.github.com/repos/simonw/datasette/issues/266 | 397534404 | MDEyOklzc3VlQ29tbWVudDM5NzUzNDQwNA== | 9599 | 2018-06-15T07:13:20Z | 2018-06-15T07:13:20Z | OWNER | Still to add: the streaming version that iterates through all of the pages, as seen in experimental commit https://github.com/simonw/datasette/commit/ced379ea325787b8c3bf0a614daba1fa4856a3bd | { "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
323681589 | |
https://github.com/simonw/datasette/issues/266#issuecomment-397534498 | https://api.github.com/repos/simonw/datasette/issues/266 | 397534498 | MDEyOklzc3VlQ29tbWVudDM5NzUzNDQ5OA== | 9599 | 2018-06-15T07:13:52Z | 2018-06-15T07:13:52Z | OWNER | Also needs documentation. | { "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
323681589 | |
https://github.com/simonw/datasette/issues/266#issuecomment-397729945 | https://api.github.com/repos/simonw/datasette/issues/266 | 397729945 | MDEyOklzc3VlQ29tbWVudDM5NzcyOTk0NQ== | 9599 | 2018-06-15T20:13:05Z | 2018-06-15T20:13:05Z | OWNER | The "This data as ..." area of the page is getting a bit untidy, especially if I'm going to add other download options in the future. I think I'll move the HTML to the page footer (less concerns about taking up lots of space there) and then have a bit of JavaScript that turns it into a show/hide menu of some sort in its current location. | { "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
323681589 |