issue_comments
8,358 rows where author_association = "OWNER" sorted by issue
This data as json, CSV (advanced)
issue >30
- Show column metadata plus links for foreign keys on arbitrary query results 51
- Redesign default .json format 50
- ?_extra= support (draft) 48
- Rethink how .ext formats (v.s. ?_format=) works before 1.0 47
- Updated Dockerfile with SpatiaLite version 5.0 45
- Complete refactor of TableView and table.html template 45
- Port Datasette to ASGI 38
- Authentication (and permissions) as a core concept 38
- JavaScript plugin hooks mechanism similar to pluggy 38
- invoke_startup() is not run in some conditions, e.g. gunicorn/uvicorn workers, breaking lots of things 35
- await datasette.client.get(path) mechanism for executing internal requests 33
- Maintain an in-memory SQLite table of connected databases and their tables 31
- Deploy a live instance of demos/apache-proxy 31
- Server hang on parallel execution of queries to named in-memory databases 30
- Ability to sort (and paginate) by column 29
- Research: demonstrate if parallel SQL queries are worthwhile 29
- Default API token authentication mechanism 29
- Port as many tests as possible to async def tests against ds_client 28
- Add ?_extra= mechanism for requesting extra properties in JSON 27
- Export to CSV 27
- Optimize all those calls to index_list and foreign_key_list 27
- Ability for a canned query to write to the database 26
- table.transform() method for advanced alter table 26
- Upgrade to CodeMirror 6, add SQL autocomplete 26
- Proof of concept for Datasette on AWS Lambda with EFS 25
- New pattern for views that return either JSON or HTML, available for plugins 25
- DeprecationWarning: pkg_resources is deprecated as an API 25
- Support cross-database joins 24
- Redesign register_output_renderer callback 24
- "datasette insert" command and plugin hook 23
- …
user 1
- simonw 8,258
id | html_url | issue_url | node_id | user | created_at | updated_at | author_association | body | reactions | issue ▼ | performed_via_github_app |
---|---|---|---|---|---|---|---|---|---|---|---|
339395551 | https://github.com/simonw/datasette/issues/40#issuecomment-339395551 | https://api.github.com/repos/simonw/datasette/issues/40 | MDEyOklzc3VlQ29tbWVudDMzOTM5NTU1MQ== | simonw 9599 | 2017-10-25T16:49:32Z | 2017-10-25T16:49:32Z | OWNER | Simplest implementation will be to create a temporary directory somewhere, copy in a Dockerfile and the databases and run “now” in it. Ideally I can use symlinks rather than copying potentially large database files around. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement command-line tool interface 268470572 | |
339514819 | https://github.com/simonw/datasette/issues/40#issuecomment-339514819 | https://api.github.com/repos/simonw/datasette/issues/40 | MDEyOklzc3VlQ29tbWVudDMzOTUxNDgxOQ== | simonw 9599 | 2017-10-26T00:35:46Z | 2017-10-26T00:35:46Z | OWNER | I’m going to have a single command-line app that does everything. Name to be decided - options include dataset, stateless, datasite (I quite like that - it reflects SQLite and the fact that you create a website) |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement command-line tool interface 268470572 | |
339515822 | https://github.com/simonw/datasette/issues/40#issuecomment-339515822 | https://api.github.com/repos/simonw/datasette/issues/40 | MDEyOklzc3VlQ29tbWVudDMzOTUxNTgyMg== | simonw 9599 | 2017-10-26T00:43:34Z | 2017-10-26T00:43:34Z | OWNER | datasite .
datasite . -p 8001
datasite blah.db blah2.db
You can’t specify more than one directory. You can specify as many files as you like. If you specify two files with different oaths but the same name then they must be accessed by hash. datasite publish .
datasite publish http://path-to-db.db
datasite blah.db -m metadata.json If you specify a directory it looks for metadata.json in that directory. Otherwise you can pass an explicit metadata file oath with -m or —metadata |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement command-line tool interface 268470572 | |
339516032 | https://github.com/simonw/datasette/issues/40#issuecomment-339516032 | https://api.github.com/repos/simonw/datasette/issues/40 | MDEyOklzc3VlQ29tbWVudDMzOTUxNjAzMg== | simonw 9599 | 2017-10-26T00:44:52Z | 2017-10-26T00:44:52Z | OWNER | Another potential name: datapi |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement command-line tool interface 268470572 | |
339517846 | https://github.com/simonw/datasette/issues/40#issuecomment-339517846 | https://api.github.com/repos/simonw/datasette/issues/40 | MDEyOklzc3VlQ29tbWVudDMzOTUxNzg0Ng== | simonw 9599 | 2017-10-26T00:58:39Z | 2017-10-26T00:58:39Z | OWNER | { "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement command-line tool interface 268470572 | ||
339724700 | https://github.com/simonw/datasette/issues/40#issuecomment-339724700 | https://api.github.com/repos/simonw/datasette/issues/40 | MDEyOklzc3VlQ29tbWVudDMzOTcyNDcwMA== | simonw 9599 | 2017-10-26T16:35:20Z | 2017-10-26T16:35:20Z | OWNER | Here’s how to make the “serve” subcommand the default if it is called with no arguments:
|
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement command-line tool interface 268470572 | |
339891755 | https://github.com/simonw/datasette/issues/40#issuecomment-339891755 | https://api.github.com/repos/simonw/datasette/issues/40 | MDEyOklzc3VlQ29tbWVudDMzOTg5MTc1NQ== | simonw 9599 | 2017-10-27T07:10:53Z | 2017-10-27T07:10:53Z | OWNER | Deploys to Now aren't working at the moment - they aren't showing the uploaded databases, because I've broken the path handling somehow. I need to do a bit more work here. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement command-line tool interface 268470572 | |
340561577 | https://github.com/simonw/datasette/issues/40#issuecomment-340561577 | https://api.github.com/repos/simonw/datasette/issues/40 | MDEyOklzc3VlQ29tbWVudDM0MDU2MTU3Nw== | simonw 9599 | 2017-10-30T19:43:40Z | 2017-10-30T19:43:40Z | OWNER | http://the-hitchhikers-guide-to-packaging.readthedocs.io/en/latest/quickstart.html describes how to package this for PyPI |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement command-line tool interface 268470572 | |
341945420 | https://github.com/simonw/datasette/issues/40#issuecomment-341945420 | https://api.github.com/repos/simonw/datasette/issues/40 | MDEyOklzc3VlQ29tbWVudDM0MTk0NTQyMA== | simonw 9599 | 2017-11-05T02:55:07Z | 2017-11-05T02:55:07Z | OWNER | To simplify things a bit, I'm going to require that every database is explicitly listed in the command line. I won't support "serve everything in this directory" for the moment. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement command-line tool interface 268470572 | |
342030075 | https://github.com/simonw/datasette/issues/40#issuecomment-342030075 | https://api.github.com/repos/simonw/datasette/issues/40 | MDEyOklzc3VlQ29tbWVudDM0MjAzMDA3NQ== | simonw 9599 | 2017-11-06T02:25:48Z | 2017-11-06T02:25:48Z | OWNER | ... I tried that, I don't like it. I'm going to bring back "directory serving" by allowing you to pass a directory as an argument to |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement command-line tool interface 268470572 | |
343646740 | https://github.com/simonw/datasette/issues/40#issuecomment-343646740 | https://api.github.com/repos/simonw/datasette/issues/40 | MDEyOklzc3VlQ29tbWVudDM0MzY0Njc0MA== | simonw 9599 | 2017-11-11T07:27:33Z | 2017-11-11T07:27:33Z | OWNER | I'm happy with this now that I've implemented the publish command in #26 |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement command-line tool interface 268470572 | |
339866724 | https://github.com/simonw/datasette/issues/41#issuecomment-339866724 | https://api.github.com/repos/simonw/datasette/issues/41 | MDEyOklzc3VlQ29tbWVudDMzOTg2NjcyNA== | simonw 9599 | 2017-10-27T04:04:52Z | 2017-10-27T04:04:52Z | OWNER | { "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Homepage should show summary of databases 268590777 | ||
343708447 | https://github.com/simonw/datasette/issues/42#issuecomment-343708447 | https://api.github.com/repos/simonw/datasette/issues/42 | MDEyOklzc3VlQ29tbWVudDM0MzcwODQ0Nw== | simonw 9599 | 2017-11-12T02:12:15Z | 2017-11-12T02:12:15Z | OWNER | I ditched the metadata file concept. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Homepage UI for editing metadata file 268591332 | |
343752404 | https://github.com/simonw/datasette/issues/42#issuecomment-343752404 | https://api.github.com/repos/simonw/datasette/issues/42 | MDEyOklzc3VlQ29tbWVudDM0Mzc1MjQwNA== | simonw 9599 | 2017-11-12T17:20:10Z | 2017-11-12T17:20:10Z | OWNER | Re-opening this - I've decided to bring back this concept, see #68 |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Homepage UI for editing metadata file 268591332 | |
345810031 | https://github.com/simonw/datasette/issues/42#issuecomment-345810031 | https://api.github.com/repos/simonw/datasette/issues/42 | MDEyOklzc3VlQ29tbWVudDM0NTgxMDAzMQ== | simonw 9599 | 2017-11-20T19:51:29Z | 2017-11-20T19:51:29Z | OWNER | See also #138 |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Homepage UI for editing metadata file 268591332 | |
350521619 | https://github.com/simonw/datasette/issues/42#issuecomment-350521619 | https://api.github.com/repos/simonw/datasette/issues/42 | MDEyOklzc3VlQ29tbWVudDM1MDUyMTYxOQ== | simonw 9599 | 2017-12-10T03:02:14Z | 2017-12-10T03:02:14Z | OWNER | I think the |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Homepage UI for editing metadata file 268591332 | |
344180866 | https://github.com/simonw/datasette/issues/43#issuecomment-344180866 | https://api.github.com/repos/simonw/datasette/issues/43 | MDEyOklzc3VlQ29tbWVudDM0NDE4MDg2Ng== | simonw 9599 | 2017-11-14T08:25:37Z | 2017-11-14T08:25:37Z | OWNER | This isn’t necessary - restarting the server is fast and easy, and I’ve not found myself needing this at all during development. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
While running, server should spot new db files added to its directory 268592894 | |
342484889 | https://github.com/simonw/datasette/issues/44#issuecomment-342484889 | https://api.github.com/repos/simonw/datasette/issues/44 | MDEyOklzc3VlQ29tbWVudDM0MjQ4NDg4OQ== | simonw 9599 | 2017-11-07T13:39:49Z | 2017-11-07T13:39:49Z | OWNER | I’m going to call this feature “count values” |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
?_group_count=country - return counts by specific column(s) 269731374 | |
345342512 | https://github.com/simonw/datasette/issues/44#issuecomment-345342512 | https://api.github.com/repos/simonw/datasette/issues/44 | MDEyOklzc3VlQ29tbWVudDM0NTM0MjUxMg== | simonw 9599 | 2017-11-17T19:27:53Z | 2017-11-20T04:37:35Z | OWNER | This should support multiple columns, e.g. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
?_group_count=country - return counts by specific column(s) 269731374 | |
345343079 | https://github.com/simonw/datasette/issues/44#issuecomment-345343079 | https://api.github.com/repos/simonw/datasette/issues/44 | MDEyOklzc3VlQ29tbWVudDM0NTM0MzA3OQ== | simonw 9599 | 2017-11-17T19:29:43Z | 2017-11-17T19:29:43Z | OWNER | Should this support sum/avg/etc as well? |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
?_group_count=country - return counts by specific column(s) 269731374 | |
345494971 | https://github.com/simonw/datasette/issues/44#issuecomment-345494971 | https://api.github.com/repos/simonw/datasette/issues/44 | MDEyOklzc3VlQ29tbWVudDM0NTQ5NDk3MQ== | simonw 9599 | 2017-11-19T06:15:39Z | 2017-11-19T06:15:39Z | OWNER | It would be great if this could support foreign key references and automatically resolve and hyperlink them if they are detected. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
?_group_count=country - return counts by specific column(s) 269731374 | |
345537315 | https://github.com/simonw/datasette/issues/44#issuecomment-345537315 | https://api.github.com/repos/simonw/datasette/issues/44 | MDEyOklzc3VlQ29tbWVudDM0NTUzNzMxNQ== | simonw 9599 | 2017-11-19T18:11:27Z | 2017-11-19T18:11:27Z | OWNER | This would enable faceted search - moving it to the search milestone. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
?_group_count=country - return counts by specific column(s) 269731374 | |
345601103 | https://github.com/simonw/datasette/issues/44#issuecomment-345601103 | https://api.github.com/repos/simonw/datasette/issues/44 | MDEyOklzc3VlQ29tbWVudDM0NTYwMTEwMw== | simonw 9599 | 2017-11-20T06:13:35Z | 2017-11-20T06:13:35Z | OWNER | { "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
?_group_count=country - return counts by specific column(s) 269731374 | ||
384676488 | https://github.com/simonw/datasette/issues/44#issuecomment-384676488 | https://api.github.com/repos/simonw/datasette/issues/44 | MDEyOklzc3VlQ29tbWVudDM4NDY3NjQ4OA== | simonw 9599 | 2018-04-26T15:09:57Z | 2018-04-26T15:09:57Z | OWNER | Remaining work for this is tracked in #150 |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
?_group_count=country - return counts by specific column(s) 269731374 | |
344161226 | https://github.com/simonw/datasette/issues/46#issuecomment-344161226 | https://api.github.com/repos/simonw/datasette/issues/46 | MDEyOklzc3VlQ29tbWVudDM0NDE2MTIyNg== | simonw 9599 | 2017-11-14T06:41:21Z | 2017-11-14T06:41:21Z | OWNER | Spatial extensions would be really useful too. https://www.gaia-gis.it/spatialite-2.1/SpatiaLite-manual.html |
{ "total_count": 1, "+1": 1, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Dockerfile should build more recent SQLite with FTS5 and spatialite support 271301468 | |
344161371 | https://github.com/simonw/datasette/issues/46#issuecomment-344161371 | https://api.github.com/repos/simonw/datasette/issues/46 | MDEyOklzc3VlQ29tbWVudDM0NDE2MTM3MQ== | simonw 9599 | 2017-11-14T06:42:15Z | 2017-11-14T06:42:15Z | OWNER | http://charlesleifer.com/blog/going-fast-with-sqlite-and-python/ is useful here too. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Dockerfile should build more recent SQLite with FTS5 and spatialite support 271301468 | |
344161430 | https://github.com/simonw/datasette/issues/46#issuecomment-344161430 | https://api.github.com/repos/simonw/datasette/issues/46 | MDEyOklzc3VlQ29tbWVudDM0NDE2MTQzMA== | simonw 9599 | 2017-11-14T06:42:44Z | 2017-11-14T06:42:44Z | OWNER | Also requested on Twitter: https://twitter.com/DenubisX/status/930322813864439808 |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Dockerfile should build more recent SQLite with FTS5 and spatialite support 271301468 | |
344975156 | https://github.com/simonw/datasette/issues/46#issuecomment-344975156 | https://api.github.com/repos/simonw/datasette/issues/46 | MDEyOklzc3VlQ29tbWVudDM0NDk3NTE1Ng== | simonw 9599 | 2017-11-16T16:19:44Z | 2017-11-16T16:19:44Z | OWNER | That's fantastic! Thank you very much for that. Do you know if it's possible to view the Dockerfile used by https://hub.docker.com/r/prolocutor/python3-sqlite-ext/ ? |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Dockerfile should build more recent SQLite with FTS5 and spatialite support 271301468 | |
344976104 | https://github.com/simonw/datasette/issues/46#issuecomment-344976104 | https://api.github.com/repos/simonw/datasette/issues/46 | MDEyOklzc3VlQ29tbWVudDM0NDk3NjEwNA== | simonw 9599 | 2017-11-16T16:22:45Z | 2017-11-16T16:22:45Z | OWNER | Found a relevant Dockerfile on Reddit: https://www.reddit.com/r/Python/comments/5unkb3/install_sqlite3_on_python_3/ddzdz2b/ |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Dockerfile should build more recent SQLite with FTS5 and spatialite support 271301468 | |
344976882 | https://github.com/simonw/datasette/issues/46#issuecomment-344976882 | https://api.github.com/repos/simonw/datasette/issues/46 | MDEyOklzc3VlQ29tbWVudDM0NDk3Njg4Mg== | simonw 9599 | 2017-11-16T16:25:07Z | 2017-11-16T16:25:07Z | OWNER | Maybe part of the solution here is to add a |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Dockerfile should build more recent SQLite with FTS5 and spatialite support 271301468 | |
344988591 | https://github.com/simonw/datasette/issues/46#issuecomment-344988591 | https://api.github.com/repos/simonw/datasette/issues/46 | MDEyOklzc3VlQ29tbWVudDM0NDk4ODU5MQ== | simonw 9599 | 2017-11-16T16:59:51Z | 2017-11-16T16:59:51Z | OWNER | OK, |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Dockerfile should build more recent SQLite with FTS5 and spatialite support 271301468 | |
344989340 | https://github.com/simonw/datasette/issues/46#issuecomment-344989340 | https://api.github.com/repos/simonw/datasette/issues/46 | MDEyOklzc3VlQ29tbWVudDM0NDk4OTM0MA== | simonw 9599 | 2017-11-16T17:02:07Z | 2017-11-16T17:02:07Z | OWNER | The fact that |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Dockerfile should build more recent SQLite with FTS5 and spatialite support 271301468 | |
344995571 | https://github.com/simonw/datasette/issues/46#issuecomment-344995571 | https://api.github.com/repos/simonw/datasette/issues/46 | MDEyOklzc3VlQ29tbWVudDM0NDk5NTU3MQ== | simonw 9599 | 2017-11-16T17:22:32Z | 2017-11-16T17:22:32Z | OWNER | The JSON extension would be very worthwhile too: https://www.sqlite.org/json1.html |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Dockerfile should build more recent SQLite with FTS5 and spatialite support 271301468 | |
345138347 | https://github.com/simonw/datasette/issues/46#issuecomment-345138347 | https://api.github.com/repos/simonw/datasette/issues/46 | MDEyOklzc3VlQ29tbWVudDM0NTEzODM0Nw== | simonw 9599 | 2017-11-17T03:52:25Z | 2017-11-17T03:52:25Z | OWNER | We now have a Dockerfile that compiles spatialite! https://github.com/simonw/datasette/pull/114/commits/6c6b63d890529eeefcefb7ab126ea3bd7b2315c1 |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Dockerfile should build more recent SQLite with FTS5 and spatialite support 271301468 | |
345259115 | https://github.com/simonw/datasette/issues/46#issuecomment-345259115 | https://api.github.com/repos/simonw/datasette/issues/46 | MDEyOklzc3VlQ29tbWVudDM0NTI1OTExNQ== | simonw 9599 | 2017-11-17T14:32:12Z | 2017-11-17T14:32:12Z | OWNER | OK, I can confirm that the version in the new docker container supports FTS5, JSON and spatialite! Notes on how I built the container and tested the spatialite extension are here: https://github.com/simonw/datasette/issues/112#issuecomment-345255655 To confirm that JSON and FTS5 are working, I ran the following:
If I do the same thing in python3 on my OS X laptop directly, I get this:
|
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Dockerfile should build more recent SQLite with FTS5 and spatialite support 271301468 | |
342521344 | https://github.com/simonw/datasette/issues/47#issuecomment-342521344 | https://api.github.com/repos/simonw/datasette/issues/47 | MDEyOklzc3VlQ29tbWVudDM0MjUyMTM0NA== | simonw 9599 | 2017-11-07T15:37:45Z | 2017-11-07T15:37:45Z | OWNER | GDS Registries could be fun too: https://registers.cloudapps.digital/ |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Create neat example database 271831408 | |
343647102 | https://github.com/simonw/datasette/issues/47#issuecomment-343647102 | https://api.github.com/repos/simonw/datasette/issues/47 | MDEyOklzc3VlQ29tbWVudDM0MzY0NzEwMg== | simonw 9599 | 2017-11-11T07:36:00Z | 2017-11-11T07:36:00Z | OWNER | http://2016.padjo.org/tutorials/data-primer-census-acs1-demographics/ has a sqlite database: http://2016.padjo.org/files/data/starterpack/census-acs-1year/acs-1-year-2015.sqlite I tested this by deploying it here: https://datasette-fewuggrvwr.now.sh/ |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Create neat example database 271831408 | |
343690060 | https://github.com/simonw/datasette/issues/47#issuecomment-343690060 | https://api.github.com/repos/simonw/datasette/issues/47 | MDEyOklzc3VlQ29tbWVudDM0MzY5MDA2MA== | simonw 9599 | 2017-11-11T19:56:08Z | 2017-11-11T19:56:08Z | OWNER |
|
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Create neat example database 271831408 | |
343705966 | https://github.com/simonw/datasette/issues/47#issuecomment-343705966 | https://api.github.com/repos/simonw/datasette/issues/47 | MDEyOklzc3VlQ29tbWVudDM0MzcwNTk2Ng== | simonw 9599 | 2017-11-12T01:00:20Z | 2017-11-12T01:00:20Z | OWNER | https://github.com/fivethirtyeight/data has a ton of CSVs |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Create neat example database 271831408 | |
344132481 | https://github.com/simonw/datasette/issues/47#issuecomment-344132481 | https://api.github.com/repos/simonw/datasette/issues/47 | MDEyOklzc3VlQ29tbWVudDM0NDEzMjQ4MQ== | simonw 9599 | 2017-11-14T03:08:13Z | 2017-11-14T03:08:13Z | OWNER | I ended up shipping with https://fivethirtyeight.datasettes.com/ and https://parlgov.datasettes.com/ |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Create neat example database 271831408 | |
343168796 | https://github.com/simonw/datasette/issues/48#issuecomment-343168796 | https://api.github.com/repos/simonw/datasette/issues/48 | MDEyOklzc3VlQ29tbWVudDM0MzE2ODc5Ng== | simonw 9599 | 2017-11-09T14:22:21Z | 2017-11-09T14:22:21Z | OWNER | Won't fix: ujson is not compatible with the custom JSON encoder I'm using here: https://github.com/simonw/immutabase/blob/b2dee11fcd989d9e2a7bf4de1e23dbc320c05013/immutabase/app.py#L401-L416 |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Switch to ujson 272391665 | |
343239062 | https://github.com/simonw/datasette/issues/48#issuecomment-343239062 | https://api.github.com/repos/simonw/datasette/issues/48 | MDEyOklzc3VlQ29tbWVudDM0MzIzOTA2Mg== | simonw 9599 | 2017-11-09T18:01:46Z | 2017-11-09T18:01:46Z | OWNER | This looks promising: https://github.com/esnme/ultrajson/issues/124#issuecomment-323882878 |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Switch to ujson 272391665 | |
379556637 | https://github.com/simonw/datasette/issues/48#issuecomment-379556637 | https://api.github.com/repos/simonw/datasette/issues/48 | MDEyOklzc3VlQ29tbWVudDM3OTU1NjYzNw== | simonw 9599 | 2018-04-08T14:56:52Z | 2018-04-08T14:56:52Z | OWNER | It would be useful to have a microbenchmark in place to help understand how much of a performance benefit this would actually provide. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Switch to ujson 272391665 | |
504883688 | https://github.com/simonw/datasette/issues/48#issuecomment-504883688 | https://api.github.com/repos/simonw/datasette/issues/48 | MDEyOklzc3VlQ29tbWVudDUwNDg4MzY4OA== | simonw 9599 | 2019-06-24T06:57:43Z | 2019-06-24T06:57:43Z | OWNER | I've seen no evidence that JSON handling is even close to being a performance bottleneck, so wontfix. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Switch to ujson 272391665 | |
343237982 | https://github.com/simonw/datasette/issues/49#issuecomment-343237982 | https://api.github.com/repos/simonw/datasette/issues/49 | MDEyOklzc3VlQ29tbWVudDM0MzIzNzk4Mg== | simonw 9599 | 2017-11-09T17:58:01Z | 2017-11-09T17:58:01Z | OWNER | More terms:
I want to capture the idea of publishing an immutable database in a stateless container. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Pick a name 272661336 | |
343238262 | https://github.com/simonw/datasette/issues/49#issuecomment-343238262 | https://api.github.com/repos/simonw/datasette/issues/49 | MDEyOklzc3VlQ29tbWVudDM0MzIzODI2Mg== | simonw 9599 | 2017-11-09T17:58:59Z | 2017-11-09T17:58:59Z | OWNER | The name should ideally be available on PyPI and should make sense as both a command line application and a library. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Pick a name 272661336 | |
343281876 | https://github.com/simonw/datasette/issues/49#issuecomment-343281876 | https://api.github.com/repos/simonw/datasette/issues/49 | MDEyOklzc3VlQ29tbWVudDM0MzI4MTg3Ng== | simonw 9599 | 2017-11-09T20:30:42Z | 2017-11-09T20:30:42Z | OWNER | How about datasette? |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Pick a name 272661336 | |
343551356 | https://github.com/simonw/datasette/issues/49#issuecomment-343551356 | https://api.github.com/repos/simonw/datasette/issues/49 | MDEyOklzc3VlQ29tbWVudDM0MzU1MTM1Ng== | simonw 9599 | 2017-11-10T18:33:22Z | 2017-11-10T18:33:22Z | OWNER | I'm going with datasette. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Pick a name 272661336 | |
343266326 | https://github.com/simonw/datasette/issues/50#issuecomment-343266326 | https://api.github.com/repos/simonw/datasette/issues/50 | MDEyOklzc3VlQ29tbWVudDM0MzI2NjMyNg== | simonw 9599 | 2017-11-09T19:33:18Z | 2017-11-09T19:33:18Z | OWNER | { "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Unit tests against application itself 272694136 | ||
343698214 | https://github.com/simonw/datasette/issues/50#issuecomment-343698214 | https://api.github.com/repos/simonw/datasette/issues/50 | MDEyOklzc3VlQ29tbWVudDM0MzY5ODIxNA== | simonw 9599 | 2017-11-11T22:23:21Z | 2017-11-11T22:23:21Z | OWNER | I'm closing #50 - more tests will be added in the future, but the framework is neatly in place for them now. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Unit tests against application itself 272694136 | |
344017088 | https://github.com/simonw/datasette/issues/51#issuecomment-344017088 | https://api.github.com/repos/simonw/datasette/issues/51 | MDEyOklzc3VlQ29tbWVudDM0NDAxNzA4OA== | simonw 9599 | 2017-11-13T18:44:23Z | 2017-11-13T18:44:23Z | OWNER | { "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Make a proper README 272735257 | ||
343557070 | https://github.com/simonw/datasette/issues/52#issuecomment-343557070 | https://api.github.com/repos/simonw/datasette/issues/52 | MDEyOklzc3VlQ29tbWVudDM0MzU1NzA3MA== | simonw 9599 | 2017-11-10T18:57:47Z | 2017-11-10T18:57:47Z | OWNER | https://file.io/ looks like it could be good for this. It's been around since 2015, and lets you upload a temporary file which can be downloaded once.
Downloading from that URL serves up the data with a
|
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Solution for temporarily uploading DB so it can be built by docker 273026602 | |
350521635 | https://github.com/simonw/datasette/issues/52#issuecomment-350521635 | https://api.github.com/repos/simonw/datasette/issues/52 | MDEyOklzc3VlQ29tbWVudDM1MDUyMTYzNQ== | simonw 9599 | 2017-12-10T03:02:56Z | 2017-12-10T03:02:56Z | OWNER | I don't think this is necessary. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Solution for temporarily uploading DB so it can be built by docker 273026602 | |
343699115 | https://github.com/simonw/datasette/issues/53#issuecomment-343699115 | https://api.github.com/repos/simonw/datasette/issues/53 | MDEyOklzc3VlQ29tbWVudDM0MzY5OTExNQ== | simonw 9599 | 2017-11-11T22:41:38Z | 2017-11-11T22:41:38Z | OWNER | This needs to incorporate a sensible way of presenting custom SQL query results too. And let's get a textarea in there for executing SQL while we're at it. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement a better database index page 273054652 | |
343707624 | https://github.com/simonw/datasette/issues/53#issuecomment-343707624 | https://api.github.com/repos/simonw/datasette/issues/53 | MDEyOklzc3VlQ29tbWVudDM0MzcwNzYyNA== | simonw 9599 | 2017-11-12T01:47:45Z | 2017-11-12T01:47:45Z | OWNER | Split the SQL thing out into #65 |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement a better database index page 273054652 | |
343707676 | https://github.com/simonw/datasette/issues/53#issuecomment-343707676 | https://api.github.com/repos/simonw/datasette/issues/53 | MDEyOklzc3VlQ29tbWVudDM0MzcwNzY3Ng== | simonw 9599 | 2017-11-12T01:49:07Z | 2017-11-12T01:49:07Z | OWNER | Here's the new design: Also lists views at the bottom (refs #54): |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Implement a better database index page 273054652 | |
343644891 | https://github.com/simonw/datasette/issues/54#issuecomment-343644891 | https://api.github.com/repos/simonw/datasette/issues/54 | MDEyOklzc3VlQ29tbWVudDM0MzY0NDg5MQ== | simonw 9599 | 2017-11-11T06:39:54Z | 2017-11-11T06:39:54Z | OWNER | I can detect something is a view like this:
|
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Views should not attempt to link to records / use rowids 273121803 | |
344060070 | https://github.com/simonw/datasette/issues/55#issuecomment-344060070 | https://api.github.com/repos/simonw/datasette/issues/55 | MDEyOklzc3VlQ29tbWVudDM0NDA2MDA3MA== | simonw 9599 | 2017-11-13T21:14:13Z | 2017-11-13T21:14:13Z | OWNER | I'm going to add some extra metadata to setup.py and then tag this as version 0.8:
Then to ship to PyPI:
|
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Ship first version to PyPI 273127117 | |
344061762 | https://github.com/simonw/datasette/issues/55#issuecomment-344061762 | https://api.github.com/repos/simonw/datasette/issues/55 | MDEyOklzc3VlQ29tbWVudDM0NDA2MTc2Mg== | simonw 9599 | 2017-11-13T21:19:43Z | 2017-11-13T21:19:43Z | OWNER | And we're live! https://pypi.python.org/pypi/datasette |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Ship first version to PyPI 273127117 | |
392601478 | https://github.com/simonw/datasette/issues/56#issuecomment-392601478 | https://api.github.com/repos/simonw/datasette/issues/56 | MDEyOklzc3VlQ29tbWVudDM5MjYwMTQ3OA== | simonw 9599 | 2018-05-28T20:50:24Z | 2018-05-28T20:50:24Z | OWNER | I'm going to close this as WONTFIX for the moment. Once Plugins #14 grows the ability to add extra URL paths and views someone who needs this could build it as a plugin instead. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Easy way to block search engine crawling in robots.txt 273127443 | |
343769692 | https://github.com/simonw/datasette/issues/57#issuecomment-343769692 | https://api.github.com/repos/simonw/datasette/issues/57 | MDEyOklzc3VlQ29tbWVudDM0Mzc2OTY5Mg== | simonw 9599 | 2017-11-12T21:32:36Z | 2017-11-12T21:32:36Z | OWNER | I have created a Docker Hub public repository for this: https://hub.docker.com/r/simonwillison/datasette/ |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Ship a Docker image of the whole thing 273127694 | |
344149165 | https://github.com/simonw/datasette/issues/57#issuecomment-344149165 | https://api.github.com/repos/simonw/datasette/issues/57 | MDEyOklzc3VlQ29tbWVudDM0NDE0OTE2NQ== | simonw 9599 | 2017-11-14T05:16:34Z | 2017-11-14T05:17:14Z | OWNER | I’m intrigued by this pattern: https://github.com/macropin/datasette/blob/147195c2fdfa2b984d8f9fc1c6cab6634970a056/Dockerfile#L8 What’s the benefit of doing that? Does it result in a smaller image size? |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Ship a Docker image of the whole thing 273127694 | |
344185817 | https://github.com/simonw/datasette/issues/57#issuecomment-344185817 | https://api.github.com/repos/simonw/datasette/issues/57 | MDEyOklzc3VlQ29tbWVudDM0NDE4NTgxNw== | simonw 9599 | 2017-11-14T08:46:24Z | 2017-11-14T08:46:24Z | OWNER | Thanks for the explanation! Please do start a pull request. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Ship a Docker image of the whole thing 273127694 | |
400903871 | https://github.com/simonw/datasette/issues/57#issuecomment-400903871 | https://api.github.com/repos/simonw/datasette/issues/57 | MDEyOklzc3VlQ29tbWVudDQwMDkwMzg3MQ== | simonw 9599 | 2018-06-28T04:01:38Z | 2018-06-28T04:01:38Z | OWNER | Shipped to Docker Hub: https://hub.docker.com/r/datasetteproject/datasette/ I did this manually the first time. I'll set Travis up to do this automatically in #329 |
{ "total_count": 1, "+1": 0, "-1": 0, "laugh": 0, "hooray": 1, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Ship a Docker image of the whole thing 273127694 | |
343676574 | https://github.com/simonw/datasette/issues/59#issuecomment-343676574 | https://api.github.com/repos/simonw/datasette/issues/59 | MDEyOklzc3VlQ29tbWVudDM0MzY3NjU3NA== | simonw 9599 | 2017-11-11T16:29:48Z | 2017-11-11T16:29:48Z | OWNER | See also #14 |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
datasette publish hyper 273157085 | |
344081876 | https://github.com/simonw/datasette/issues/59#issuecomment-344081876 | https://api.github.com/repos/simonw/datasette/issues/59 | MDEyOklzc3VlQ29tbWVudDM0NDA4MTg3Ng== | simonw 9599 | 2017-11-13T22:33:43Z | 2017-11-13T22:33:43Z | OWNER | The |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
datasette publish hyper 273157085 | |
344141199 | https://github.com/simonw/datasette/issues/59#issuecomment-344141199 | https://api.github.com/repos/simonw/datasette/issues/59 | MDEyOklzc3VlQ29tbWVudDM0NDE0MTE5OQ== | simonw 9599 | 2017-11-14T04:13:11Z | 2017-11-14T04:13:11Z | OWNER | I managed to do this manually:
At this point, visiting the IP address in a browser showed the parlgov UI. To clean up...
|
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
datasette publish hyper 273157085 | |
491945391 | https://github.com/simonw/datasette/issues/59#issuecomment-491945391 | https://api.github.com/repos/simonw/datasette/issues/59 | MDEyOklzc3VlQ29tbWVudDQ5MTk0NTM5MQ== | simonw 9599 | 2019-05-13T19:00:44Z | 2019-05-13T19:01:00Z | OWNER | Hyper shut down at the start of this year: https://news.ycombinator.com/item?id=18734658 |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
datasette publish hyper 273157085 | |
343683566 | https://github.com/simonw/datasette/issues/60#issuecomment-343683566 | https://api.github.com/repos/simonw/datasette/issues/60 | MDEyOklzc3VlQ29tbWVudDM0MzY4MzU2Ng== | simonw 9599 | 2017-11-11T18:12:24Z | 2017-11-11T18:12:24Z | OWNER | I’m going to solve this by making it an optional argument you can pass to the serve command. Then the Dockerfile can still build and use it but it won’t interfere with tests or dev. If argument is not passed, we will calculate hashes on startup and calculate table row counts on demand. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Rethink how metadata is generated and stored 273163905 | |
343697291 | https://github.com/simonw/datasette/issues/63#issuecomment-343697291 | https://api.github.com/repos/simonw/datasette/issues/63 | MDEyOklzc3VlQ29tbWVudDM0MzY5NzI5MQ== | simonw 9599 | 2017-11-11T22:05:06Z | 2017-11-11T22:11:49Z | OWNER | I'm going to bundle sql and sql_params together into a query nested object like this:
|
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Review design of JSON output 273174447 | |
345260784 | https://github.com/simonw/datasette/issues/64#issuecomment-345260784 | https://api.github.com/repos/simonw/datasette/issues/64 | MDEyOklzc3VlQ29tbWVudDM0NTI2MDc4NA== | simonw 9599 | 2017-11-17T14:38:21Z | 2017-11-17T14:38:21Z | OWNER | This was fixed by ed2b3f25beac720f14869350baacc5f62b065194 in #107 - thanks @raynae! |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Support for ?field__isnull=1 or similar 273181020 | |
343709217 | https://github.com/simonw/datasette/issues/65#issuecomment-343709217 | https://api.github.com/repos/simonw/datasette/issues/65 | MDEyOklzc3VlQ29tbWVudDM0MzcwOTIxNw== | simonw 9599 | 2017-11-12T02:36:37Z | 2017-11-12T02:36:37Z | OWNER | { "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Re-implement ?sql= mode 273191608 | ||
343752683 | https://github.com/simonw/datasette/issues/66#issuecomment-343752683 | https://api.github.com/repos/simonw/datasette/issues/66 | MDEyOklzc3VlQ29tbWVudDM0Mzc1MjY4Mw== | simonw 9599 | 2017-11-12T17:24:05Z | 2017-11-12T17:24:21Z | OWNER | Maybe SQL views should have their own Sanic view class ( |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Show table SQL on table page 273191806 | |
343961784 | https://github.com/simonw/datasette/issues/67#issuecomment-343961784 | https://api.github.com/repos/simonw/datasette/issues/67 | MDEyOklzc3VlQ29tbWVudDM0Mzk2MTc4NA== | simonw 9599 | 2017-11-13T15:50:50Z | 2017-11-13T15:50:50Z | OWNER |
|
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Command that builds a local docker container 273192789 | |
343967020 | https://github.com/simonw/datasette/issues/67#issuecomment-343967020 | https://api.github.com/repos/simonw/datasette/issues/67 | MDEyOklzc3VlQ29tbWVudDM0Mzk2NzAyMA== | simonw 9599 | 2017-11-13T16:06:10Z | 2017-11-13T16:06:10Z | OWNER | { "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Command that builds a local docker container 273192789 | ||
343753999 | https://github.com/simonw/datasette/issues/68#issuecomment-343753999 | https://api.github.com/repos/simonw/datasette/issues/68 | MDEyOklzc3VlQ29tbWVudDM0Mzc1Mzk5OQ== | simonw 9599 | 2017-11-12T17:45:21Z | 2017-11-12T19:38:33Z | OWNER | For initial launch, I could just support this as some optional command line arguments you pass to the publish command:
|
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Support for title/source/license metadata 273247186 | |
343754058 | https://github.com/simonw/datasette/issues/68#issuecomment-343754058 | https://api.github.com/repos/simonw/datasette/issues/68 | MDEyOklzc3VlQ29tbWVudDM0Mzc1NDA1OA== | simonw 9599 | 2017-11-12T17:46:13Z | 2017-11-12T17:46:13Z | OWNER | I’m going to store this stuff in a file called metadata.json and move the existing automatically generated metadata to a file called build.json |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Support for title/source/license metadata 273247186 | |
343791348 | https://github.com/simonw/datasette/issues/68#issuecomment-343791348 | https://api.github.com/repos/simonw/datasette/issues/68 | MDEyOklzc3VlQ29tbWVudDM0Mzc5MTM0OA== | simonw 9599 | 2017-11-13T02:12:58Z | 2017-11-13T02:12:58Z | OWNER | I should use this on https://fivethirtyeight.datasettes.com/ |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Support for title/source/license metadata 273247186 | |
343951751 | https://github.com/simonw/datasette/issues/68#issuecomment-343951751 | https://api.github.com/repos/simonw/datasette/issues/68 | MDEyOklzc3VlQ29tbWVudDM0Mzk1MTc1MQ== | simonw 9599 | 2017-11-13T15:21:04Z | 2017-11-13T15:21:04Z | OWNER | For first version, I'm just supporting title, source and license information at the database level. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Support for title/source/license metadata 273247186 | |
343752579 | https://github.com/simonw/datasette/issues/69#issuecomment-343752579 | https://api.github.com/repos/simonw/datasette/issues/69 | MDEyOklzc3VlQ29tbWVudDM0Mzc1MjU3OQ== | simonw 9599 | 2017-11-12T17:22:39Z | 2017-11-12T17:22:39Z | OWNER | By default I'll allow LIMIT and OFFSET up to a maximum of X (where X is let's say 50,000 to start with, but can be custom configured to a larger number or set to None for no limit). |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Enforce pagination (or at least limits) for arbitrary custom SQL 273248366 | |
343780039 | https://github.com/simonw/datasette/issues/69#issuecomment-343780039 | https://api.github.com/repos/simonw/datasette/issues/69 | MDEyOklzc3VlQ29tbWVudDM0Mzc4MDAzOQ== | simonw 9599 | 2017-11-13T00:05:27Z | 2017-11-13T00:05:27Z | OWNER | I think the only safe way to do this is using SQLite |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Enforce pagination (or at least limits) for arbitrary custom SQL 273248366 | |
344019631 | https://github.com/simonw/datasette/issues/69#issuecomment-344019631 | https://api.github.com/repos/simonw/datasette/issues/69 | MDEyOklzc3VlQ29tbWVudDM0NDAxOTYzMQ== | simonw 9599 | 2017-11-13T18:53:13Z | 2017-11-13T18:53:13Z | OWNER | I'm going with a page size of 100 and a max limit of 1000 |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Enforce pagination (or at least limits) for arbitrary custom SQL 273248366 | |
344048656 | https://github.com/simonw/datasette/issues/69#issuecomment-344048656 | https://api.github.com/repos/simonw/datasette/issues/69 | MDEyOklzc3VlQ29tbWVudDM0NDA0ODY1Ng== | simonw 9599 | 2017-11-13T20:32:47Z | 2017-11-13T20:32:47Z | OWNER | { "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Enforce pagination (or at least limits) for arbitrary custom SQL 273248366 | ||
343780141 | https://github.com/simonw/datasette/issues/71#issuecomment-343780141 | https://api.github.com/repos/simonw/datasette/issues/71 | MDEyOklzc3VlQ29tbWVudDM0Mzc4MDE0MQ== | simonw 9599 | 2017-11-13T00:06:52Z | 2017-11-13T00:06:52Z | OWNER | I've registered datasettes.com as a domain name for doing this. Now setting it up so Cloudflare and Now can serve content from it. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Set up some example datasets on a Cloudflare-backed domain 273278840 | |
343780539 | https://github.com/simonw/datasette/issues/71#issuecomment-343780539 | https://api.github.com/repos/simonw/datasette/issues/71 | MDEyOklzc3VlQ29tbWVudDM0Mzc4MDUzOQ== | simonw 9599 | 2017-11-13T00:13:29Z | 2017-11-13T00:19:46Z | OWNER | https://zeit.co/docs/features/dns is docs
I had to set up a custom TXT record on |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Set up some example datasets on a Cloudflare-backed domain 273278840 | |
343780671 | https://github.com/simonw/datasette/issues/71#issuecomment-343780671 | https://api.github.com/repos/simonw/datasette/issues/71 | MDEyOklzc3VlQ29tbWVudDM0Mzc4MDY3MQ== | simonw 9599 | 2017-11-13T00:15:21Z | 2017-11-13T00:17:37Z | OWNER |
|
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Set up some example datasets on a Cloudflare-backed domain 273278840 | |
343780814 | https://github.com/simonw/datasette/issues/71#issuecomment-343780814 | https://api.github.com/repos/simonw/datasette/issues/71 | MDEyOklzc3VlQ29tbWVudDM0Mzc4MDgxNA== | simonw 9599 | 2017-11-13T00:17:50Z | 2017-11-13T00:18:19Z | OWNER | Achieved those redirects using Cloudflare "page rules": https://www.cloudflare.com/a/page-rules/datasettes.com |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Set up some example datasets on a Cloudflare-backed domain 273278840 | |
343781030 | https://github.com/simonw/datasette/issues/71#issuecomment-343781030 | https://api.github.com/repos/simonw/datasette/issues/71 | MDEyOklzc3VlQ29tbWVudDM0Mzc4MTAzMA== | simonw 9599 | 2017-11-13T00:21:05Z | 2017-11-13T02:09:32Z | OWNER |
|
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Set up some example datasets on a Cloudflare-backed domain 273278840 | |
343788581 | https://github.com/simonw/datasette/issues/71#issuecomment-343788581 | https://api.github.com/repos/simonw/datasette/issues/71 | MDEyOklzc3VlQ29tbWVudDM0Mzc4ODU4MQ== | simonw 9599 | 2017-11-13T01:48:17Z | 2017-11-13T01:48:17Z | OWNER | I had to add a rule like this to get letsencrypt certificates on now.sh working: https://github.com/zeit/now-cli/issues/188#issuecomment-270105052 I also have to flip this switch off every time I want to add a new alias: |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Set up some example datasets on a Cloudflare-backed domain 273278840 | |
343788780 | https://github.com/simonw/datasette/issues/71#issuecomment-343788780 | https://api.github.com/repos/simonw/datasette/issues/71 | MDEyOklzc3VlQ29tbWVudDM0Mzc4ODc4MA== | simonw 9599 | 2017-11-13T01:50:01Z | 2017-11-13T01:50:01Z | OWNER | Added another page rule in order to get Cloudflare to always obey cache headers sent by the server: |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Set up some example datasets on a Cloudflare-backed domain 273278840 | |
343788817 | https://github.com/simonw/datasette/issues/71#issuecomment-343788817 | https://api.github.com/repos/simonw/datasette/issues/71 | MDEyOklzc3VlQ29tbWVudDM0Mzc4ODgxNw== | simonw 9599 | 2017-11-13T01:50:27Z | 2017-11-13T01:50:27Z | OWNER | https://fivethirtyeight.datasettes.com/ is now up and running. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Set up some example datasets on a Cloudflare-backed domain 273278840 | |
343789162 | https://github.com/simonw/datasette/issues/71#issuecomment-343789162 | https://api.github.com/repos/simonw/datasette/issues/71 | MDEyOklzc3VlQ29tbWVudDM0Mzc4OTE2Mg== | simonw 9599 | 2017-11-13T01:53:29Z | 2017-11-13T01:53:29Z | OWNER | ``` $ curl -i 'https://fivethirtyeight.datasettes.com/fivethirtyeight-75d605c/obama-commutations%2Fobama_commutations.csv.jsono' HTTP/1.1 200 OK Date: Mon, 13 Nov 2017 01:50:57 GMT Content-Type: application/json Transfer-Encoding: chunked Connection: keep-alive Set-Cookie: __cfduid=de836090f3e12a60579cc7a1696cf0d9e1510537857; expires=Tue, 13-Nov-18 01:50:57 GMT; path=/; domain=.datasettes.com; HttpOnly; Secure Access-Control-Allow-Origin: * Cache-Control: public, max-age=31536000 X-Now-Region: now-sfo CF-Cache-Status: HIT Expires: Tue, 13 Nov 2018 01:50:57 GMT Server: cloudflare-nginx CF-RAY: 3bce154a6d9293b4-SJC {"database": "fivethirtyeight", "table": "obama-commutations/obama_commutations.csv"...``` |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Set up some example datasets on a Cloudflare-backed domain 273278840 | |
343790984 | https://github.com/simonw/datasette/issues/71#issuecomment-343790984 | https://api.github.com/repos/simonw/datasette/issues/71 | MDEyOklzc3VlQ29tbWVudDM0Mzc5MDk4NA== | simonw 9599 | 2017-11-13T02:09:34Z | 2017-11-13T02:09:34Z | OWNER | HTTP/2 push totally worked on the redirect!
Meanwhile, in the network pane... |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Set up some example datasets on a Cloudflare-backed domain 273278840 | |
343801392 | https://github.com/simonw/datasette/issues/73#issuecomment-343801392 | https://api.github.com/repos/simonw/datasette/issues/73 | MDEyOklzc3VlQ29tbWVudDM0MzgwMTM5Mg== | simonw 9599 | 2017-11-13T03:36:47Z | 2017-11-13T03:36:47Z | OWNER | While I’m at it, let’s allow people to opt out of HTTP/2 push with a ?_nopush=1 argument too - in case they decide they don’t want to receive large 302 responses. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
_nocache=1 query string option for use with sort-by-random 273296178 | |
392574415 | https://github.com/simonw/datasette/issues/73#issuecomment-392574415 | https://api.github.com/repos/simonw/datasette/issues/73 | MDEyOklzc3VlQ29tbWVudDM5MjU3NDQxNQ== | simonw 9599 | 2018-05-28T17:25:14Z | 2018-05-28T17:25:14Z | OWNER | I implemented this as |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
_nocache=1 query string option for use with sort-by-random 273296178 | |
344018680 | https://github.com/simonw/datasette/issues/74#issuecomment-344018680 | https://api.github.com/repos/simonw/datasette/issues/74 | MDEyOklzc3VlQ29tbWVudDM0NDAxODY4MA== | simonw 9599 | 2017-11-13T18:49:58Z | 2017-11-13T18:49:58Z | OWNER | Turns out it does this already: https://github.com/simonw/datasette/blob/6b3b05b6db0d2a7b7cec8b8dbb4ddc5e12a376b2/datasette/app.py#L96-L107 |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Send a 302 redirect to the new hash for hits to old hashes 273296684 | |
344000982 | https://github.com/simonw/datasette/issues/75#issuecomment-344000982 | https://api.github.com/repos/simonw/datasette/issues/75 | MDEyOklzc3VlQ29tbWVudDM0NDAwMDk4Mg== | simonw 9599 | 2017-11-13T17:50:27Z | 2017-11-13T17:50:27Z | OWNER | This is necessary because one of the fun things to do with this tool is run it locally, e.g.:
BUT... if we enable CORS by default, an evil site could try sniffing for localhost:8003 and attempt to steal data. So we'll enable the CORS headers only if |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Add --cors argument to serve 273509159 | |
344141515 | https://github.com/simonw/datasette/issues/79#issuecomment-344141515 | https://api.github.com/repos/simonw/datasette/issues/79 | MDEyOklzc3VlQ29tbWVudDM0NDE0MTUxNQ== | simonw 9599 | 2017-11-14T04:16:01Z | 2017-11-14T04:16:01Z | OWNER | This is probably a bit too much for the README - I should get readthedocs working. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Add more detailed API documentation to the README 273569068 | |
384675792 | https://github.com/simonw/datasette/issues/79#issuecomment-384675792 | https://api.github.com/repos/simonw/datasette/issues/79 | MDEyOklzc3VlQ29tbWVudDM4NDY3NTc5Mg== | simonw 9599 | 2018-04-26T15:08:13Z | 2018-04-26T15:08:13Z | OWNER | Docs now live at http://datasette.readthedocs.io/ I still need to document a few more parts of the API before closing this. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Add more detailed API documentation to the README 273569068 | |
392574358 | https://github.com/simonw/datasette/issues/79#issuecomment-392574358 | https://api.github.com/repos/simonw/datasette/issues/79 | MDEyOklzc3VlQ29tbWVudDM5MjU3NDM1OA== | simonw 9599 | 2018-05-28T17:24:48Z | 2018-05-28T17:24:48Z | OWNER | Closing this as obsolete in favor of other issues tagged documentation. |
{ "total_count": 0, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 0, "rocket": 0, "eyes": 0 } |
Add more detailed API documentation to the README 273569068 |
Advanced export
JSON shape: default, array, newline-delimited, object
CREATE TABLE [issue_comments] ( [html_url] TEXT, [issue_url] TEXT, [id] INTEGER PRIMARY KEY, [node_id] TEXT, [user] INTEGER REFERENCES [users]([id]), [created_at] TEXT, [updated_at] TEXT, [author_association] TEXT, [body] TEXT, [reactions] TEXT, [issue] INTEGER REFERENCES [issues]([id]) , [performed_via_github_app] TEXT); CREATE INDEX [idx_issue_comments_issue] ON [issue_comments] ([issue]); CREATE INDEX [idx_issue_comments_user] ON [issue_comments] ([user]);
updated_at (date) >30 ✖