, sql = 'select ', params = {'id': '1'}` caused by an invalid query when loading incoming FKs.
The error was ignored due to async but it still got printed to the console.
- Allow custom units to be registered with Pint. \[Russ Garrett\]
- Support units in filters. \[Russ Garrett\]
- Tidy up units support. \[Russ Garrett\]
- Add units to exported JSON
- Units key in metadata skeleton
- Docs
- Initial units support. \[Russ Garrett\]
Add support for specifying units for a column in `metadata.json` and rendering them on display using [pint](https://pint.readthedocs.io/en/latest/)",107914493,
https://github.com/simonw/datasette/releases/tag/0.19,10575542,MDc6UmVsZWFzZTEwNTc1NTQy,0.19,main,Datasette 0.19: plugins preview,0,9599,0,2018-04-17T02:12:21Z,2018-04-17T02:21:51Z,"This is the first preview of the new Datasette plugins mechanism. Only two plugin hooks are available so far - for custom SQL functions and custom template filters. There's plenty more to come - read [the documentation](https://datasette.readthedocs.io/en/latest/plugins.html) and get involved in [the tracking ticket](https://github.com/simonw/datasette/issues/14) if you have feedback on the direction so far.
- Fix for `_sort_desc=sortable_with_nulls` test, refs [#216](https://github.com/simonw/datasette/issues/216)
- Fixed [#216](https://github.com/simonw/datasette/issues/216) - paginate correctly when sorting by nullable column
- Initial documentation for plugins, closes [#213](https://github.com/simonw/datasette/issues/213)
https://datasette.readthedocs.io/en/latest/plugins.html
- New `--plugins-dir=plugins/` option ([#212](https://github.com/simonw/datasette/issues/212))
New option causing Datasette to load and evaluate all of the Python files in the specified directory and register any plugins that are defined in those files.
This new option is available for the following commands:
datasette serve mydb.db --plugins-dir=plugins/
datasette publish now/heroku mydb.db --plugins-dir=plugins/
datasette package mydb.db --plugins-dir=plugins/
- Start of the plugin system, based on pluggy ([#210](https://github.com/simonw/datasette/issues/14))
Uses https://pluggy.readthedocs.io/ originally created for the py.test project
We're starting with two plugin hooks:
`prepare_connection(conn)`
This is called when a new SQLite connection is created. It can be used to register custom SQL functions.
`prepare_jinja2_environment(env)`
This is called with the Jinja2 environment. It can be used to register custom template tags and filters.
An example plugin which uses these two hooks can be found at https://github.com/simonw/datasette-plugin-demos or installed using `pip install datasette-plugin-demos`
Refs [#14](https://github.com/simonw/datasette/issues/14)
- Return HTTP 405 on InvalidUsage rather than 500. [Russ Garrett]
This also stops it filling up the logs. This happens for HEAD requests at the moment - which perhaps should be handled better, but that's a different issue.",107914493,
https://github.com/simonw/datasette/releases/tag/0.20,10645022,MDc6UmVsZWFzZTEwNjQ1MDIy,0.20,main,Datasette 0.20: static assets and templates for plugins,0,9599,0,2018-04-20T14:36:29Z,2018-04-20T14:41:14Z,"Mostly new work on the [Plugins](http://datasette.readthedocs.io/en/latest/plugins.html) mechanism: plugins can now bundle static assets and custom templates, and ``datasette publish`` has a new ``--install=name-of-plugin`` option.
- Add col-X classes to HTML table on custom query page
- Fixed out-dated template in documentation
- Plugins can now bundle custom templates, #224
- Added /-/metadata /-/plugins /-/inspect, #225
- Documentation for --install option, refs #223
- Datasette publish/package --install option, #223
- Fix for plugins in Python 3.5, #222
- New plugin hooks: extra_css_urls() and extra_js_urls(), #214
- /-/static-plugins/PLUGIN_NAME/ now serves static/ from plugins
- now gets class=""col-X"" - plus added col-X documentation
- Use to_css_class for table cell column classes
This ensures that columns with spaces in the name will still
generate usable CSS class names. Refs #209
- Add column name classes to | s, make PK bold [Russ Garrett]
- Don't duplicate simple primary keys in the link column [Russ Garrett]
When there's a simple (single-column) primary key, it looks weird to
duplicate it in the link column.
This change removes the second PK column and treats the link column as
if it were the PK column from a header/sorting perspective.
- Correct escaping for HTML display of row links [Russ Garrett]
- Longer time limit for test_paginate_compound_keys
It was failing intermittently in Travis - see #209
- Use application/octet-stream for downloadable databses
- Updated PyPI classifiers
- Updated PyPI link to pypi.org",107914493,
https://github.com/simonw/datasette/releases/tag/0.21,10868113,MDc6UmVsZWFzZTEwODY4MTEz,0.21,main,"Datasette 0.21: New _shape=, new _size=, search within columns",0,9599,0,2018-05-05T23:15:38Z,2018-05-05T23:21:33Z,"New JSON `_shape=` options, the ability to set table `_size=` and a mechanism for searching within specific columns.
- Default tests to using a longer timelimit
Every now and then a test will fail in Travis CI on Python 3.5 because it hit the default 20ms SQL time limit.
Test fixtures now default to a 200ms time limit, and we only use the 20ms time limit for the specific test that tests query interruption.
This should make our tests on Python 3.5 in Travis much more stable.
- Support `_search_COLUMN=text` searches, closes [\#237](https://github.com/simonw/datasette/issues/237)
- Show version on `/-/plugins` page, closes [\#248](https://github.com/simonw/datasette/issues/248)
- `?_size=max` option, closes [\#249](https://github.com/simonw/datasette/issues/249)
- Added `/-/versions` and `/-/versions.json`, closes [\#244](https://github.com/simonw/datasette/issues/244)
Sample output:
{
""python"": {
""version"": ""3.6.3"",
""full"": ""3.6.3 (default, Oct 4 2017, 06:09:38) \n[GCC 4.2.1 Compatible Apple LLVM 9.0.0 (clang-900.0.37)]""
},
""datasette"": {
""version"": ""0.20""
},
""sqlite"": {
""version"": ""3.23.1"",
""extensions"": {
""json1"": null,
""spatialite"": ""4.3.0a""
}
}
}
- Renamed `?_sql_time_limit_ms=` to `?_timelimit`, closes [\#242](https://github.com/simonw/datasette/issues/242)
- New `?_shape=array` option + tweaks to `_shape`, closes [\#245](https://github.com/simonw/datasette/issues/245)
- Default is now `?_shape=arrays` (renamed from `lists`)
- New `?_shape=array` returns an array of objects as the root object
- Changed `?_shape=object` to return the object as the root
- Updated docs
- FTS tables now detected by `inspect()`, closes [\#240](https://github.com/simonw/datasette/issues/240)
- New `?_size=XXX` querystring parameter for table view, closes [\#229](https://github.com/simonw/datasette/issues/229)
Also added documentation for all of the `_special` arguments.
Plus deleted some duplicate logic implementing `_group_count`.
- If `max_returned_rows==page_size`, increment `max_returned_rows` - fixes [\#230](https://github.com/simonw/datasette/issues/230)
- New `hidden: True` option for table metadata, closes [\#239](https://github.com/simonw/datasette/issues/239)
- Hide `idx_*` tables if spatialite detected, closes [\#228](https://github.com/simonw/datasette/issues/228)
- Added `class=rows-and-columns` to custom query results table
- Added CSS class `rows-and-columns` to main table
- `label_column` option in `metadata.json` - closes [\#234](https://github.com/simonw/datasette/issues/234)",107914493,
https://github.com/simonw/datasette/releases/tag/0.22,11087850,MDc6UmVsZWFzZTExMDg3ODUw,0.22,main,Datasette 0.22: Datasette Facets,0,9599,0,2018-05-20T23:41:47Z,2018-05-20T23:44:19Z,"The big new feature in this release is [facets](http://datasette.readthedocs.io/en/latest/facets.html). Datasette can now apply faceted browse to any column in any table. It will also suggest possible facets. See the [Datasette Facets](https://simonwillison.net/2018/May/20/datasette-facets/) announcement post for more details.
In addition to the work on facets:
- Added [docs for introspection endpoints](https://datasette.readthedocs.io/en/latest/introspection.html)
- New `--config` option, added `--help-config`, closes #274
Removed the `--page_size=` argument to `datasette serve` in favour of:
datasette serve --config default_page_size:50 mydb.db
Added new help section:
$ datasette --help-config
Config options:
default_page_size Default page size for the table view
(default=100)
max_returned_rows Maximum rows that can be returned from a table
or custom query (default=1000)
sql_time_limit_ms Time limit for a SQL query in milliseconds
(default=1000)
default_facet_size Number of values to return for requested facets
(default=30)
facet_time_limit_ms Time limit for calculating a requested facet
(default=200)
facet_suggest_time_limit_ms Time limit for calculating a suggested facet
(default=50)
- Only apply responsive table styles to `.rows-and-column`
Otherwise they interfere with tables in the description, e.g. on
https://fivethirtyeight.datasettes.com/fivethirtyeight/nba-elo%2Fnbaallelo
- Refactored views into new `views/` modules, refs #256
- [Documentation for SQLite full-text search](http://datasette.readthedocs.io/en/latest/full_text_search.html) support, closes #253
- `/-/versions` now includes SQLite `fts_versions`, closes #252",107914493,
https://github.com/simonw/datasette/releases/tag/0.22.1,11136605,MDc6UmVsZWFzZTExMTM2NjA1,0.22.1,main,Datasette 0.22.1,0,9599,0,2018-05-23T14:00:01Z,2018-05-23T14:04:17Z,"Bugfix release, plus we now use [versioneer](https://github.com/warner/python-versioneer) for our version numbers.
- Faceting no longer breaks pagination, fixes #282
- Add ``__version_info__`` derived from `__version__` [Robert Gieseke]
This might be tuple of more than two values (major and minor
version) if commits have been made after a release.
- Add version number support with Versioneer. [Robert Gieseke]
Versioneer Licence:
Public Domain (CC0-1.0)
Closes #273
- Refactor inspect logic [Russ Garrett]",107914493,
https://github.com/simonw/datasette/releases/tag/0.23,11530498,MDc6UmVsZWFzZTExNTMwNDk4,0.23,main,"Datasette 0.23: CSV, SpatiaLite and more",0,9599,0,2018-06-18T15:11:57Z,2018-06-18T15:28:37Z,"This release features CSV export, improved options for foreign key expansions, new configuration settings and improved support for SpatiaLite.
See full release notes here: http://datasette.readthedocs.io/en/latest/changelog.html#v0-23",107914493,
https://github.com/simonw/datasette/releases/tag/0.23.1,11591352,MDc6UmVsZWFzZTExNTkxMzUy,0.23.1,main,Datasette 0.23.1,0,9599,0,2018-06-21T15:37:13Z,2018-06-21T16:02:44Z,"Minor bugfix release.
* Correctly display empty strings in HTML table, closes #314
* Allow “.” in database filenames, closes #302
* 404s ending in slash redirect to remove that slash, closes #309
* Fixed incorrect display of compound primary keys with foreign key references. Closes #319
* Docs + example of canned SQL query using || concatenation. Closes #321
* Correctly display facets with value of 0 - closes #318
* Default ‘expand labels’ to checked in CSV advanced export
",107914493,
https://github.com/simonw/datasette/releases/tag/0.23.2,11825600,MDc6UmVsZWFzZTExODI1NjAw,0.23.2,main,Datasette 0.23.2,0,9599,0,2018-07-08T05:28:45Z,2018-07-08T05:41:38Z,"Minor bugfix and documentation release.
* CSV export now respects `--cors`, fixes #326
* [Installation instructions](https://datasette.readthedocs.io/en/latest/installation.html) including docker image - closes #328
* Fix for row pages for tables with / in, closes #325",107914493,
https://github.com/simonw/datasette/releases/tag/0.24,12080036,MDc6UmVsZWFzZTEyMDgwMDM2,0.24,main,Datasette 0.24,0,9599,0,2018-07-24T04:34:38Z,2018-07-24T16:51:29Z,"See full release notes here: http://datasette.readthedocs.io/en/latest/changelog.html#v0-24
",107914493,
https://github.com/simonw/datasette/releases/tag/0.46,29489364,MDc6UmVsZWFzZTI5NDg5MzY0,0.46,main,0.46,0,9599,0,2020-08-09T16:09:07Z,2020-08-09T16:10:47Z,"**Warning:** This release contains a security fix related to authenticated writable canned queries. If you are using this feature you should upgrade as soon as possible.
- **Security fix:** CSRF tokens were incorrectly included in read-only canned query forms, which could allow them to be leaked to a sophisticated attacker. See [issue 918](https://github.com/simonw/datasette/issues/918) for details.
- Datasette now supports GraphQL via the new [datasette-graphql](https://github.com/simonw/datasette-graphql) plugin - see [GraphQL in Datasette with the new datasette-graphql plugin](https://simonwillison.net/2020/Aug/7/datasette-graphql/).
- Principle git branch has been renamed from `master` to `main`. ([#849](https://github.com/simonw/datasette/issues/849))
- New debugging tool: `/-/allow-debug tool` ([demo here](https://latest.datasette.io/-/allow-debug)) helps test allow blocks against actors, as described in [Defining permissions with ""allow"" blocks](https://datasette.readthedocs.io/en/stable/authentication.html#authentication-permissions-allow). ([#908](https://github.com/simonw/datasette/issues/908))
- New logo for the documentation, and a new project tagline: ""An open source multi-tool for exploring and publishing data"".
- Whitespace in column values is now respected on display, using `white-space: pre-wrap`. ([#896](https://github.com/simonw/datasette/issues/896))
- New `await request.post_body()` method for accessing the raw POST body, see [Request object](https://datasette.readthedocs.io/en/stable/internals.html#internals-request). ([#897](https://github.com/simonw/datasette/issues/897))
- Database file downloads now include a `content-length` HTTP header, enabling download progress bars. ([#905](https://github.com/simonw/datasette/issues/905))
- File downloads now also correctly set the suggested file name using a `content-disposition` HTTP header. ([#909](https://github.com/simonw/datasette/issues/909))
- `tests` are now excluded from the Datasette package properly - thanks, abeyerpath. ([#456](https://github.com/simonw/datasette/issues/456))
- The Datasette package published to PyPI now includes `sdist` as well as `bdist_wheel`.
- Better titles for canned query pages. ([#887](https://github.com/simonw/datasette/issues/887))
- Now only loads Python files from a directory passed using the `--plugins-dir` option - thanks, Amjith Ramanujam. ([#890](https://github.com/simonw/datasette/pull/890))
- New documentation section on [Publishing to Vercel](https://datasette.readthedocs.io/en/stable/publish.html#publish-vercel).",107914493,
https://github.com/simonw/datasette/releases/tag/0.47,29585154,MDc6UmVsZWFzZTI5NTg1MTU0,0.47,main,0.47,0,9599,0,2020-08-12T00:42:47Z,2020-08-12T00:44:52Z,"- Datasette now has [a GitHub discussions forum](https://github.com/simonw/datasette/discussions) for conversations about the project that go beyond just bug reports and issues.
- Datasette can now be installed on macOS using Homebrew! Run `brew install simonw/datasette/datasette`. See [Using Homebrew](https://datasette.readthedocs.io/en/stable/installation.html#installation-homebrew). ([#335](https://github.com/simonw/datasette/issues/335))
- Two new commands: `datasette install name-of-plugin` and `datasette uninstall name-of-plugin`. These are equivalent to `pip install` and `pip uninstall` but automatically run in the same virtual environment as Datasette, so users don't have to figure out where that virtual environment is - useful for installations created using Homebrew or `pipx`. See [Installing plugins](https://datasette.readthedocs.io/en/stable/plugins.html#plugins-installing). ([#925](https://github.com/simonw/datasette/issues/925))
- A new command-line option, `datasette --get`, accepts a path to a URL within the Datasette instance. It will run that request through Datasette (without starting a web server) and print out the repsonse. See [datasette --get](https://datasette.readthedocs.io/en/stable/getting_started.html#getting-started-datasette-get) for an example. ([#926](https://github.com/simonw/datasette/issues/926))",107914493,
https://github.com/simonw/datasette/releases/tag/0.47.1,29587652,MDc6UmVsZWFzZTI5NTg3NjUy,0.47.1,main,0.47.1,0,9599,0,2020-08-12T02:37:24Z,2020-08-12T02:38:00Z,- Fixed a bug where the `sdist` distribution of Datasette was not correctly including the template files. ([#930](https://github.com/simonw/datasette/issues/930)),107914493,
https://github.com/simonw/sqlite-utils/releases/tag/2.15.1,29616454,MDc6UmVsZWFzZTI5NjE2NDU0,2.15.1,main,2.15.1,0,9599,0,2020-08-12T16:59:48Z,2020-08-12T17:00:27Z,- Now available as a `sdist` package on PyPI in addition to a wheel. ([#133](https://github.com/simonw/sqlite-utils/issues/133)),140912432,
https://github.com/simonw/datasette/releases/tag/0.47.2,29625082,MDc6UmVsZWFzZTI5NjI1MDgy,0.47.2,main,0.47.2,0,9599,0,2020-08-12T20:54:33Z,2020-08-12T20:55:28Z,- Fixed an issue with the Docker image [published to Docker Hub](https://hub.docker.com/r/datasetteproject/datasette). ([#931](https://github.com/simonw/datasette/issues/931)),107914493,
https://github.com/simonw/datasette/releases/tag/0.47.3,29738457,MDc6UmVsZWFzZTI5NzM4NDU3,0.47.3,main,0.47.3,0,9599,0,2020-08-15T20:56:08Z,2020-08-15T21:03:58Z,- The `datasette --get` command-line mechanism now ensures any plugins using the `startup()` hook are correctly executed. ([#934](https://github.com/simonw/datasette/issues/934)),107914493,
https://github.com/simonw/datasette/releases/tag/0.48,29749566,MDc6UmVsZWFzZTI5NzQ5NTY2,0.48,main,0.48,0,9599,0,2020-08-16T18:56:31Z,2020-08-16T18:58:34Z,"- Datasette documentation now lives at [docs.datasette.io](https://docs.datasette.io/).
- `db.is_mutable` property is now documented and tested, see [Database introspection](https://docs.datasette.io/en/stable/internals.html#internals-database-introspection).
- The `extra_template_vars`, `extra_css_urls`, `extra_js_urls` and `extra_body_script` plugin hooks now all accept the same arguments. See [extra_template_vars(template, database, table, columns, view_name, request, datasette)](https://docs.datasette.io/en/stable/plugin_hooks.html#plugin-hook-extra-template-vars) for details. ([#939](https://github.com/simonw/datasette/issues/939))
- Those hooks now accept a new `columns` argument detailing the table columns that will be rendered on that page. ([#938](https://github.com/simonw/datasette/issues/938))
- Fixed bug where plugins calling `db.execute_write_fn()` could hang Datasette if the connection failed. ([#935](https://github.com/simonw/datasette/issues/935))
- Fixed bug with the `?_nl=on` output option and binary data. ([#914](https://github.com/simonw/datasette/issues/914))",107914493,
https://github.com/dogsheep/github-to-sqlite/releases/tag/2.5,29822005,MDc6UmVsZWFzZTI5ODIyMDA1,2.5,main,2.5,0,9599,0,2020-08-18T15:05:50Z,2020-08-18T15:08:20Z,"- New `github-to-sqlite emojis` command for fetching emoji supported by GitHub. [Demo](https://github-to-sqlite.dogsheep.net/github/emojis). #47
- Added table of contents to README.
- Switched to GitHub Actions for CI.
- Switched default branch to `main`
",207052882,
https://github.com/simonw/sqlite-utils/releases/tag/2.16,29999731,MDc6UmVsZWFzZTI5OTk5NzMx,2.16,main,2.16,0,9599,0,2020-08-21T21:02:29Z,2020-08-21T21:05:51Z,"- `--load-extension` option for `sqlite-utils query` for loading SQLite extensions. ([#134](https://github.com/simonw/sqlite-utils/issues/134))
- New `sqlite_utils.utils.find_spatialite()` function for finding SpatiaLite in common locations. ([#135](https://github.com/simonw/sqlite-utils/issues/135))",140912432,
https://github.com/simonw/sqlite-utils/releases/tag/2.16.1,30352225,MDc6UmVsZWFzZTMwMzUyMjI1,2.16.1,main,2.16.1,0,9599,0,2020-08-28T22:45:11Z,2020-08-28T22:47:02Z,"- `insert_all(..., alter=True)` now works for columns introduced after the first 100 records. Thanks, Simon Wiles! ([#139](https://github.com/simonw/sqlite-utils/issues/139))
- Continuous Integration is now powered by GitHub Actions. ([#143](https://github.com/simonw/sqlite-utils/issues/143))",140912432,
https://github.com/dogsheep/dogsheep-beta/releases/tag/0.1,30481804,MDc6UmVsZWFzZTMwNDgxODA0,0.1,main,0.1,0,9599,0,2020-09-01T06:10:44Z,2020-09-01T06:12:05Z,"- Optimize the FTS table and vacuum the database. #4
- First non-alpha release",197431109,
https://github.com/dogsheep/dogsheep-beta/releases/tag/0.2,30536189,MDc6UmVsZWFzZTMwNTM2MTg5,0.2,main,0.2,0,9599,0,2020-09-01T20:40:52Z,2020-09-01T20:41:31Z,"- Use Porter stemming by default, allow that to be over-ridden with the new `--tokenize=` option. #2",197431109,
https://github.com/dogsheep/dogsheep-beta/releases/tag/0.3,30613603,MDc6UmVsZWFzZTMwNjEzNjAz,0.3,main,0.3,0,9599,0,2020-09-02T21:07:13Z,2020-09-02T21:07:44Z,- New `category` column plus default `categories` table. #7,197431109,
https://github.com/dogsheep/dogsheep-beta/releases/tag/0.4,30688677,MDc6UmVsZWFzZTMwNjg4Njc3,0.4,main,0.4,0,9599,0,2020-09-03T21:09:50Z,2020-09-03T21:11:28Z,"- Working faceted search interface at `/-/beta` #3
- `is_public` column for filtering between public and private data. #11
- New `received` category. #10",197431109,
https://github.com/dogsheep/dogsheep-beta/releases/tag/0.4.1,30690154,MDc6UmVsZWFzZTMwNjkwMTU0,0.4.1,main,0.4.1,0,9599,0,2020-09-03T21:40:40Z,2020-09-03T21:41:52Z,- Fixed support for [advanced FTS query syntax](https://www.sqlite.org/fts5.html#full_text_query_syntax). #13,197431109,
https://github.com/dogsheep/dogsheep-beta/releases/tag/0.5,30699190,MDc6UmVsZWFzZTMwNjk5MTkw,0.5,main,0.5,0,9599,0,2020-09-04T01:45:35Z,2020-09-04T01:46:16Z,- Custom template displays can now render a point on a map. #12,197431109,
https://github.com/dogsheep/dogsheep-beta/releases/tag/0.6,30780951,MDc6UmVsZWFzZTMwNzgwOTUx,0.6,main,0.6,0,9599,0,2020-09-05T16:24:11Z,2020-09-05T16:26:06Z,"- Rerun the search query with FTS quoting if a SQLite FTS error occurs. This means searching for e.g. ""#dogfest"" will no longer throw an error, while still supporting advanced SQLite FTS syntax. #14
- Maximum width 100% on images in results
- Don't display facet headers if there are no results for that facet.",197431109,
https://github.com/simonw/sqlite-utils/releases/tag/2.17,30875333,MDc6UmVsZWFzZTMwODc1MzMz,2.17,main,2.17,0,9599,0,2020-09-07T22:08:12Z,2020-09-07T22:08:33Z,"This release handles a bug where replacing rows in FTS tables could result in growing numbers of unneccessary rows in the associated `*_fts_docsize` table. ([#149](https://github.com/simonw/sqlite-utils/issues/149))
- `PRAGMA recursive_triggers=on` by default for all connections. You can turn it off with `Database(recursive_triggers=False)`. ([#152](https://github.com/simonw/sqlite-utils/issues/152))
- `table.optimize()` method now deletes unnecessary rows from the `*_fts_docsize` table. ([#153](https://github.com/simonw/sqlite-utils/issues/153))
- New tracer method for tracking underlying SQL queries, see [Tracing queries](http://127.0.0.1:8000/python-api.html#python-api-tracing). ([#150](https://github.com/simonw/sqlite-utils/issues/150))
- Neater indentation for schema SQL. ([#148](https://github.com/simonw/sqlite-utils/issues/148))
- Documentation for `sqlite_utils.AlterError` exception thrown by in `add_foreign_keys()`.",140912432,
https://github.com/simonw/sqlite-utils/releases/tag/2.18,30942758,MDc6UmVsZWFzZTMwOTQyNzU4,2.18,main,2.18,0,9599,0,2020-09-08T23:37:28Z,2020-09-08T23:39:21Z,"- `table.rebuild_fts()` method for rebuilding a FTS index, see [Rebuilding a full-text search table](https://sqlite-utils.readthedocs.io/en/stable/python-api.html#python-api-fts-rebuild). ([#155](https://github.com/simonw/sqlite-utils/issues/155))
- `sqlite-utils rebuild-fts data.db` command for rebuilding FTS indexes across all tables, or just specific tables. ([#155](https://github.com/simonw/sqlite-utils/issues/155))
- `table.optimize()` method no longer deletes junk rows from the `*_fts_docsize` table. This was added in 2.17 but it turns out running `table.rebuild_fts()` is a better solution to this problem.
- Fixed a bug where rows with additional columns that are inserted after the first batch of records could cause an error due to breaking SQLite's maximum number of parameters. Thanks, Simon Wiles. ([#145](https://github.com/simonw/sqlite-utils/issues/145))",140912432,
https://github.com/simonw/datasette/releases/tag/0.49,31288240,MDc6UmVsZWFzZTMxMjg4MjQw,0.49,main,0.49,0,9599,0,2020-09-14T21:38:24Z,2020-09-14T21:40:11Z,"- Writable canned queries now expose a JSON API, see [JSON API for writable canned queries](https://docs.datasette.io/en/stable/sql_queries.html#canned-queries-json-api). ([#880](https://github.com/simonw/datasette/issues/880))
- New mechanism for defining page templates with custom path parameters - a template file called `pages/about/{slug}.html` will be used to render any requests to `/about/something`. See [Path parameters for pages](https://docs.datasette.io/en/stable/custom_templates.html#custom-pages-parameters). ([#944](https://github.com/simonw/datasette/issues/944))
- `register_output_renderer()` render functions can now return a `Response`. ([#953](https://github.com/simonw/datasette/issues/953))
- New `--upgrade` option for `datasette install`. ([#945](https://github.com/simonw/datasette/issues/945))
- New `datasette --pdb` option. ([#962](https://github.com/simonw/datasette/issues/962))
- `datasette --get` exit code now reflects the internal HTTP status code. ([#947](https://github.com/simonw/datasette/issues/947))
- New `raise_404()` template function for returning 404 errors. ([#964](https://github.com/simonw/datasette/issues/964))
- `datasette publish heroku` now deploys using Python 3.8.5
- Upgraded [CodeMirror](https://codemirror.net/) to 5.57.0. ([#948](https://github.com/simonw/datasette/issues/948))
- Upgraded code style to Black 20.8b1. ([#958](https://github.com/simonw/datasette/issues/958))
- Fixed bug where selected facets were not correctly persisted in hidden form fields on the table page. ([#963](https://github.com/simonw/datasette/issues/963))
- Renamed the default error template from `500.html` to `error.html`.
- Custom error pages are now documented, see [Custom error pages](https://docs.datasette.io/en/stable/custom_templates.html#custom-pages-errors). ([#965](https://github.com/simonw/datasette/issues/965))",107914493,
https://github.com/simonw/datasette/releases/tag/0.49.1,31354944,MDc6UmVsZWFzZTMxMzU0OTQ0,0.49.1,main,0.49.1,0,9599,0,2020-09-15T20:20:15Z,2020-09-15T20:21:16Z,"- Fixed a bug with writable canned queries that use magic parameters but accept no non-magic arguments. (#967)
",107914493,
https://github.com/dogsheep/github-to-sqlite/releases/tag/2.6,31441882,MDc6UmVsZWFzZTMxNDQxODgy,2.6,main,2.6,0,9599,0,2020-09-17T03:54:16Z,2020-09-17T03:55:03Z,- New `github-to-sqlite get /gists` command for making authenticated API calls against any API path. #50 ,207052882,
https://github.com/dogsheep/dogsheep-beta/releases/tag/0.7,31501128,MDc6UmVsZWFzZTMxNTAxMTI4,0.7,main,0.7,0,9599,0,2020-09-17T22:56:01Z,2020-09-17T22:57:09Z,"- Option to sort by relevance / oldest / newest. #21
- Renamed `table` column to `type`. #17
- New `-d` option for passing one or more databases to index. Without this all databases in the config file will be indexed.",197431109,
https://github.com/dogsheep/dogsheep-beta/releases/tag/0.7.1,31501584,MDc6UmVsZWFzZTMxNTAxNTg0,0.7.1,main,0.7.1,0,9599,0,2020-09-17T23:13:01Z,2020-09-17T23:13:46Z,- Fixed bug with sort orders displayed for the timeline view. #22,197431109,
https://github.com/dogsheep/dogsheep-beta/releases/tag/0.8,31547860,MDc6UmVsZWFzZTMxNTQ3ODYw,0.8,main,0.8,0,9599,0,2020-09-18T22:40:02Z,2020-09-18T22:41:33Z,"- New `template_debug` configuration setting. #25
- Templates now autoescape by default, use `{{ display.foo|safe }}` if you know you want HTML not to be escaped.
- Fixed bug where the wrong template fragment could be used for a row. #24
- Sort order is now persisted when you execute a new search. #23 ",197431109,
https://github.com/simonw/sqlite-utils/releases/tag/2.19,31581701,MDc6UmVsZWFzZTMxNTgxNzAx,2.19,main,2.19,0,9599,0,2020-09-20T22:22:56Z,2020-09-20T22:24:04Z,"- New `sqlite-utils add-foreign-keys` command for [Adding multiple foreign keys at once](https://sqlite-utils.readthedocs.io/en/stable/cli.html#cli-add-foreign-keys). ([#157](https://github.com/simonw/sqlite-utils/issues/157))
- New `table.enable_fts(..., replace=True)` argument for replacing an existing FTS table with a new configuration. ([#160](https://github.com/simonw/sqlite-utils/issues/160))
- New `table.add_foreign_key(..., ignore=True)` argument for ignoring a foreign key if it already exists. ([#112](https://github.com/simonw/sqlite-utils/issues/112))",140912432,
https://github.com/simonw/sqlite-utils/releases/tag/2.20,31680849,MDc6UmVsZWFzZTMxNjgwODQ5,2.20,main,2.20,0,9599,0,2020-09-23T00:35:52Z,2020-09-23T00:37:01Z,"This release introduces two key new capabilities: **transform** ([#114](https://github.com/simonw/sqlite-utils/issues/114)) and **extract** ([#42](https://github.com/simonw/sqlite-utils/issues/42)).
### Transform
SQLite's ALTER TABLE has [several documented limitations](https://sqlite.org/lang_altertable.html). The `table.transform()` Python method and `sqlite-utils transform` CLI command work around these limitations using a pattern where a new table with the desired structure is created, data is copied over to it and the old table is then dropped and replaced by the new one.
You can use these tools to drop columns, change column types, rename columns, add and remove `NOT NULL` and defaults, remove foreign key constraints and more. See the [transforming tables (CLI)](https://sqlite-utils.readthedocs.io/en/stable/cli.html#cli-transform-table) and [transforming tables (Python library)](https://sqlite-utils.readthedocs.io/en/stable/python-api.html#python-api-transform) documentation for full details of how to use them.
### Extract
Sometimes a database table - especially one imported from a CSV file - will contain duplicate data. A `Trees` table may include a `Species` column with only a few dozen unique values, when the table itself contains thousands of rows.
The `table.extract()` method and `sqlite-utils extract` commands can extract a column - or multiple columns - out into a separate lookup table, and set up a foreign key relationship from the original table.
The Python library [extract() documentation](https://sqlite-utils.readthedocs.io/en/stable/python-api.html#python-api-extract) describes how extraction works in detail, and [Extracting columns into a separate table](https://sqlite-utils.readthedocs.io/en/stable/cli.html#cli-extract) in the CLI documentation includes a detailed example.
### Other changes
- The `@db.register_function` decorator can be used to quickly register Python functions as custom SQL functions, see [Registering custom SQL functions](https://sqlite-utils.readthedocs.io/en/stable/python-api.html#python-api-register-function). ([#162](https://github.com/simonw/sqlite-utils/issues/162))
- The `table.rows_where()` method now accepts an optional `select=` argument for specifying which columns should be selected, see [Listing rows](https://sqlite-utils.readthedocs.io/en/stable/python-api.html#python-api-rows).",140912432,
https://github.com/simonw/sqlite-utils/releases/tag/2.21,31773390,MDc6UmVsZWFzZTMxNzczMzkw,2.21,main,2.21,0,9599,0,2020-09-24T16:44:30Z,2020-09-24T16:45:44Z,"- `table.extract()` and `sqlite-utils extract` now apply much, much faster - one example operation reduced from twelve minutes to just four seconds! ([#172](https://github.com/simonw/sqlite-utils/issues/172))
- `sqlite-utils extract` no longer shows a progress bar, because it's fast enough not to need one.
- New `column_order=` option for `table.transform()` which can be used to alter the order of columns in a table. ([#175](https://github.com/simonw/sqlite-utils/issues/175))
- `sqlite-utils transform --column-order=` option (with a `-o` shortcut) for changing column order. ([#176](https://github.com/simonw/sqlite-utils/issues/176))
- The `table.transform(drop_foreign_keys=)` parameter and the `sqlite-utils transform --drop-foreign-key` option have changed. They now accept just the name of the column rather than requiring all three of the column, other table and other column. This is technically a backwards-incompatible change but I chose not to bump the major version number because the transform feature is so new. ([#177](https://github.com/simonw/sqlite-utils/issues/177))
- The table `.disable_fts()`, `.rebuild_fts()`, `.delete()`, `.delete_where()` and `.add_missing_columns()` methods all now `return self`, which means they can be chained together with other table operations.",140912432,
https://github.com/simonw/datasette/releases/tag/0.50,32384200,MDc6UmVsZWFzZTMyMzg0MjAw,0.50,main,0.50,0,9599,0,2020-10-09T17:57:55Z,2020-10-09T17:58:27Z,"The key new feature in this release is the **column actions** menu on the table page ([#891](https://github.com/simonw/datasette/issues/891)). This can be used to sort a column in ascending or descending order, facet data by that column or filter the table to just rows that have a value for that column.
Plugin authors can use the new [datasette.client](https://docs.datasette.io/en/stable/internals.html#internals-datasette-client) object to make internal HTTP requests from their plugins, allowing them to make use of Datasette's JSON API. ([#943](https://github.com/simonw/datasette/issues/943))
New [Deploying Datasette](https://docs.datasette.io/en/stable/deploying.html#deploying) documentation with guides for deploying Datasette on a Linux server [using systemd](https://docs.datasette.io/en/stable/deploying.html#deploying-systemd) or to hosting providers [that support buildpacks](https://docs.datasette.io/en/stable/deploying.html#deploying-buildpacks). ([#514](https://github.com/simonw/datasette/issues/514), [#997](https://github.com/simonw/datasette/issues/997))
Other improvements in this release:
- [Publishing to Google Cloud Run](https://docs.datasette.io/en/stable/publish.html#publish-cloud-run) documentation now covers Google Cloud SDK options. Thanks, Geoffrey Hing. ([#995](https://github.com/simonw/datasette/pull/995))
- New `datasette -o` option which opens your browser as soon as Datasette starts up. ([#970](https://github.com/simonw/datasette/issues/970))
- Datasette now sets `sqlite3.enable_callback_tracebacks(True)` so that errors in custom SQL functions will display tracebacks. ([#891](https://github.com/simonw/datasette/issues/891))
- Fixed two rendering bugs with column headers in portrait mobile view. ([#978](https://github.com/simonw/datasette/issues/978), [#980](https://github.com/simonw/datasette/issues/980))
- New `db.table_column_details(table)` introspection method for retrieving full details of the columns in a specific table, see [Database introspection](https://docs.datasette.io/en/stable/internals.html#internals-database-introspection).
- Fixed a routing bug with custom page wildcard templates. ([#996](https://github.com/simonw/datasette/issues/996))
- `datasette publish heroku` now deploys using Python 3.8.6.
- New `datasette publish heroku --tar=` option. ([#969](https://github.com/simonw/datasette/issues/969))
- `OPTIONS` requests against HTML pages no longer return a 500 error. ([#1001](https://github.com/simonw/datasette/issues/1001))
- Datasette now supports Python 3.9.",107914493,
https://github.com/simonw/datasette/releases/tag/0.50.1,32395303,MDc6UmVsZWFzZTMyMzk1MzAz,0.50.1,main,0.50.1,0,9599,0,2020-10-10T00:41:35Z,2020-10-10T00:44:23Z,"- Fixed a bug introduced in 0.50 where the export as JSON/CSV links on the table, row and query pages were broken. (#1010)
",107914493,
https://github.com/simonw/datasette/releases/tag/0.50.2,32397338,MDc6UmVsZWFzZTMyMzk3MzM4,0.50.2,main,0.50.2,0,9599,0,2020-10-10T03:53:47Z,2020-10-10T03:59:18Z,"* Fixed another bug introduced in 0.50 where column header links on the table page were broken. (#1011)
",107914493,
https://github.com/dogsheep/evernote-to-sqlite/releases/tag/0.1,32428098,MDc6UmVsZWFzZTMyNDI4MDk4,0.1,main,0.1,0,9599,0,2020-10-11T21:46:09Z,2020-10-11T21:47:39Z,"- Initial release, with support for importing ENEX files.",303218369,
https://github.com/dogsheep/evernote-to-sqlite/releases/tag/0.2,32429687,MDc6UmVsZWFzZTMyNDI5Njg3,0.2,main,0.2,0,9599,0,2020-10-12T00:05:21Z,2020-10-12T00:07:24Z,"- Notes now use an ID derived from a hash of their contents. #3
- Date columns are now in ISO format, and indexd. #4
- Notes and resources table now have full-text search configured. #4
- Improved how OCR is stored in the database, only storing the most confident matches. #6",303218369,
https://github.com/dogsheep/swarm-to-sqlite/releases/tag/0.3.2,32470830,MDc6UmVsZWFzZTMyNDcwODMw,0.3.2,main,0.3.2,0,9599,0,2020-10-12T20:31:24Z,2020-10-12T20:33:48Z,"- Fix for ""table photos has no column named hasSticker"" bug, thanks @mattiaborsoi. #10
- Switched CI to GitHub Actions.",205429375,
https://github.com/simonw/sqlite-utils/releases/tag/2.22,32688819,MDc6UmVsZWFzZTMyNjg4ODE5,2.22,main,2.22,0,9599,0,2020-10-16T19:30:25Z,2020-10-16T19:31:45Z,"- New `--encoding` option for processing CSV and TSV files that use a non-utf-8 encoding, for both the `insert` and `update` commands. ([#182](https://github.com/simonw/sqlite-utils/issues/182))
- The `--load-extension` option is now available to many more commands. ([#137](https://github.com/simonw/sqlite-utils/issues/137))
- `--load-extension=spatialite` can be used to load SpatiaLite from common installation locations, if it is available. ([#136](https://github.com/simonw/sqlite-utils/issues/136))
- Tests now also run against Python 3.9. ([#184](https://github.com/simonw/sqlite-utils/issues/184))
- Passing `pk=[""id""]` now has the same effect as passing `pk=""id""`. ([#181](https://github.com/simonw/sqlite-utils/issues/181))",140912432,
https://github.com/dogsheep/healthkit-to-sqlite/releases/tag/1.0,32712413,MDc6UmVsZWFzZTMyNzEyNDEz,1.0,main,1.0,0,9599,0,2020-10-17T21:15:29Z,2020-10-17T21:17:34Z,"- Fixed a bug where export files generated in languages other than English failed to import. #11
- CI now uses GitHub Actions",197882382,
https://github.com/dogsheep/dogsheep-beta/releases/tag/0.9,32713381,MDc6UmVsZWFzZTMyNzEzMzgx,0.9,main,0.9,0,9599,0,2020-10-17T23:01:38Z,2020-10-17T23:03:04Z,"- Facet by date. #16
- Now depends on [Datasette 0.50.2](https://docs.datasette.io/en/stable/changelog.html#v0-50-2)
- Uses `datasette.client` and passes through authentication cookies. #28 ",197431109,
https://github.com/dogsheep/github-to-sqlite/releases/tag/2.7,32736481,MDc6UmVsZWFzZTMyNzM2NDgx,2.7,main,2.7,0,9599,0,2020-10-19T05:36:32Z,2020-10-19T05:38:34Z,"- `github-to-sqlite repos` command now takes options `--readme` and `--readme-html`, which write the README or rendered HTML README into the `readme` or `readme_html` columns, respectively. #52
- New `--accept` option for `github-to-sqlite get`. #50",207052882,
https://github.com/simonw/sqlite-utils/releases/tag/2.23,33188958,MDc6UmVsZWFzZTMzMTg4OTU4,2.23,main,2.23,0,9599,0,2020-10-28T21:38:10Z,2020-10-28T21:38:54Z,"- `table.m2m(other_table, records)` method now takes any iterable, not just a list or tuple. Thanks, Adam Wolf. ([#189](https://github.com/simonw/sqlite-utils/pull/189))
- `sqlite-utils insert` now displays a progress bar for CSV or TSV imports. ([#173](https://github.com/simonw/sqlite-utils/issues/173))
- New `@db.register_function(deterministic=True)` option for registering deterministic SQLite functions in Python 3.8 or higher. ([#191](https://github.com/simonw/sqlite-utils/issues/191))",140912432,
https://github.com/simonw/datasette/releases/tag/0.51,33311677,MDc6UmVsZWFzZTMzMzExNjc3,0.51,main,0.51,0,9599,0,2020-10-31T22:24:54Z,2020-10-31T22:29:33Z,"A new visual design, plugin hooks for adding navigation options, better handling of binary data, URL building utility methods and better support for running Datasette behind a proxy.
### New visual design
Datasette is no longer white and grey with blue and purple links! [Natalie Downe](https://twitter.com/natbat) has been working on a visual refresh, the first iteration of which is included in this release. ([#1056](https://github.com/simonw/datasette/pull/1056))
![datasette-0 51](https://user-images.githubusercontent.com/9599/97791267-d9011e80-1b8d-11eb-9b1b-42908266f36f.png)
### Plugins can now add links within Datasette
A number of existing Datasette plugins add new pages to the Datasette interface, providig tools for things like [uploading CSVs](https://github.com/simonw/datasette-upload-csvs), [editing table schemas](https://github.com/simonw/datasette-edit-schema) or [configuring full-text search](https://github.com/simonw/datasette-configure-fts).
Plugins like this can now link to themselves from other parts of Datasette interface. The [menu_links(datasette, actor)](https://docs.datasette.io/en/stable/plugin_hooks.html#plugin-hook-menu-links) hook ([#1064](https://github.com/simonw/datasette/issues/1064)) lets plugins add links to Datasette's new top-right application menu, and the [table_actions(datasette, actor, database, table)](https://docs.datasette.io/en/stable/plugin_hooks.html#plugin-hook-table-actions) hook ([#1066](https://github.com/simonw/datasette/issues/1066)) adds links to a new ""table actions"" menu on the table page.
The demo at [latest.datasette.io](https://latest.datasette.io/) now includes some example plugins. To see the new table actions menu first [sign into that demo as root](https://latest.datasette.io/login-as-root) and then visit the [facetable](https://latest.datasette.io/fixtures/facetable) table to see the new cog icon menu at the top of the page.
### Binary data
SQLite tables can contain binary data in `BLOB` columns. Datasette now provides links for users to download this data directly from Datasette, and uses those links to make binary data available from CSV exports. See [Binary data](https://docs.datasette.io/en/stable/binary_data.html#binary) for more details. ([#1036](https://github.com/simonw/datasette/issues/1036) and [#1034](https://github.com/simonw/datasette/issues/1034)).
### URL building
The new [datasette.urls](https://docs.datasette.io/en/stable/internals.html#internals-datasette-urls) family of methods can be used to generate URLs to key pages within the Datasette interface, both within custom templates and Datasette plugins. See [Building URLs within plugins](https://docs.datasette.io/en/stable/writing_plugins.html#writing-plugins-building-urls) for more details. ([#904](https://github.com/simonw/datasette/issues/904))
### Running Datasette behind a proxy
The [base_url](https://docs.datasette.io/en/stable/config.html#config-base-url) configuration option is designed to help run Datasette on a specific path behind a proxy - for example if you want to run an instance of Datasette at `/my-datasette/` within your existing site's URL hierarchy, proxied behind nginx or Apache.
Support for this configuration option has been greatly improved ([#1023](https://github.com/simonw/datasette/issues/1023)), and guidelines for using it are now available in a new documentation section on [Running Datasette behind a proxy](https://docs.datasette.io/en/stable/deploying.html#deploying-proxy). ([#1027](https://github.com/simonw/datasette/issues/1027))
### Smaller changes
- Wide tables shown within Datasette now scroll horizontally ([#998](https://github.com/simonw/datasette/issues/998)). This is achieved using a new ` ` element which may impact the implementation of some plugins (for example [this change to datasette-cluster-map](https://github.com/simonw/datasette-cluster-map/commit/fcb4abbe7df9071c5ab57defd39147de7145b34e)).
- New [debug-menu](https://docs.datasette.io/en/stable/authentication.html#permissions-debug-menu) permission. ([#1068](https://github.com/simonw/datasette/issues/1068))
- Removed `--debug` option, which didn't do anything. ([#814](https://github.com/simonw/datasette/issues/814))
- `Link:` HTTP header pagination. ([#1014](https://github.com/simonw/datasette/issues/1014))
- `x` button for clearing filters. ([#1016](https://github.com/simonw/datasette/issues/1016))
- Edit SQL button on canned queries, ([#1019](https://github.com/simonw/datasette/issues/1019))
- `--load-extension=spatialite` shortcut. ([#1028](https://github.com/simonw/datasette/issues/1028))
- scale-in animation for column action menu. ([#1039](https://github.com/simonw/datasette/issues/1039))
- Option to pass a list of templates to `.render_template()` is now documented. ([#1045](https://github.com/simonw/datasette/issues/1045))
- New `datasette.urls.static_plugins()` method. ([#1033](https://github.com/simonw/datasette/issues/1033))
- `datasette -o` option now opens the most relevant page. ([#976](https://github.com/simonw/datasette/issues/976))
- `datasette --cors` option now enables access to `/database.db` downloads. ([#1057](https://github.com/simonw/datasette/issues/1057))
- Database file downloads now implement cascading permissions, so you can download a database if you have `view-database-download` permission even if you do not have permission to access the Datasette instance. ([#1058](https://github.com/simonw/datasette/issues/1058))
- New documentation on [Designing URLs for your plugin](https://docs.datasette.io/en/stable/writing_plugins.html#writing-plugins-designing-urls). ([#1053](https://github.com/simonw/datasette/issues/1053))",107914493,
https://github.com/simonw/datasette/releases/tag/0.51.1,33314301,MDc6UmVsZWFzZTMzMzE0MzAx,0.51.1,main,0.51.1,0,9599,0,2020-11-01T03:33:47Z,2020-11-01T03:34:36Z,- Improvements to the new [Binary data](https://docs.datasette.io/en/stable/binary_data.html#binary) documentation page.,107914493,
https://github.com/simonw/sqlite-utils/releases/tag/3.0,33615120,MDc6UmVsZWFzZTMzNjE1MTIw,3.0,main,3.0,0,9599,0,2020-11-08T17:23:38Z,2020-11-08T17:24:27Z,"This release introduces a new `sqlite-utils search` command for searching tables, see [Executing searches](https://sqlite-utils.readthedocs.io/en/latest/cli.html#cli-search). ([#192](https://github.com/simonw/sqlite-utils/issues/192))
The `table.search()` method has been redesigned, see [Searching with table.search()](https://sqlite-utils.readthedocs.io/en/latest/python-api.html#python-api-fts-search). ([#197](https://github.com/simonw/sqlite-utils/issues/197))
The release includes minor backwards-incompatible changes, hence the version bump to 3.0. Those changes, which should not affect most users, are:
- The `-c` shortcut option for outputting CSV is no longer available. The full `--csv` option is required instead.
- The `-f` shortcut for `--fmt` has also been removed - use `--fmt`.
- The `table.search()` method now defaults to sorting by relevance, not sorting by `rowid`. ([#198](https://github.com/simonw/sqlite-utils/issues/198))
- The `table.search()` method now returns a generator over a list of Python dictionaries. It previously returned a list of tuples.
Also in this release:
- The `query`, `tables`, `rows` and `search` CLI commands now accept a new `--tsv` option which outputs the results in TSV. ([#193](https://github.com/simonw/sqlite-utils/issues/193))
- A new `table.virtual_table_using` property reveals if a table is a virtual table, and returns the upper case type of virtual table (e.g. `FTS4` or `FTS5`) if it is. It returns `None` if the table is not a virtual table. ([#196](https://github.com/simonw/sqlite-utils/issues/196))
- The new `table.search_sql()` method returns the SQL for searching a table, see [Building SQL queries with table.search_sql()](https://sqlite-utils.readthedocs.io/en/latest/python-api.html#python-api-fts-search-sql).
- `sqlite-utils rows` now accepts multiple optional `-c` parameters specifying the columns to return. ([#200](https://github.com/simonw/sqlite-utils/issues/200))
Changes since the 3.0a0 alpha release:
- The `sqlite-utils search` command now defaults to returning every result, unless you add a `--limit 20` option.
- The `sqlite-utils search -c` and `table.search(columns=[])` options are now fully respected. ([#201](https://github.com/simonw/sqlite-utils/issues/201))",140912432,
https://github.com/simonw/datasette/releases/tag/0.52,34539374,MDc6UmVsZWFzZTM0NTM5Mzc0,0.52,main,0.52,0,9599,0,2020-11-28T23:54:35Z,2020-11-28T23:57:12Z,"This release includes a number of changes relating to an internal rebranding effort: Datasette's **configuration** mechanism (things like `datasette --config default_page_size:10`) has been renamed to **settings**.
- New `--setting default_page_size 10` option as a replacement for `--config default_page_size:10` (note the lack of a colon). The `--config` option is deprecated but will continue working until Datasette 1.0. ([#992](https://github.com/simonw/datasette/issues/992))
- The `/-/config` introspection page is now `/-/settings`, and the previous page redirects to the new one. ([#1103](https://github.com/simonw/datasette/issues/1103))
- The `config.json` file in [Configuration directory mode](https://docs.datasette.io/en/stable/settings.html#config-dir) is now called `settings.json`. ([#1104](https://github.com/simonw/datasette/issues/1104))
- The undocumented `datasette.config()` internal method has been replaced by a documented [.setting(key)](https://docs.datasette.io/en/stable/internals.html#datasette-setting) method. ([#1107](https://github.com/simonw/datasette/issues/1107))
Also in this release:
- New plugin hook: [database_actions(datasette, actor, database)](https://docs.datasette.io/en/stable/plugin_hooks.html#plugin-hook-database-actions), which adds menu items to a new cog menu shown at the top of the database page. ([#1077](https://github.com/simonw/datasette/issues/1077))
- `datasette publish cloudrun` has a new `--apt-get-install` option that can be used to install additional Ubuntu packages as part of the deployment. This is useful for deploying the new [datasette-ripgrep plugin](https://github.com/simonw/datasette-ripgrep). ([#1110](https://github.com/simonw/datasette/issues/1110))
- Swept the documentation to remove words that minimize involved difficulty. ([#1089](https://github.com/simonw/datasette/issues/1089))
And some bug fixes:
- Foreign keys linking to rows with blank label columns now display as a hyphen, allowing those links to be clicked. ([#1086](https://github.com/simonw/datasette/issues/1086))
- Fixed bug where row pages could sometimes 500 if the underlying queries exceeded a time limit. ([#1088](https://github.com/simonw/datasette/issues/1088))
- Fixed a bug where the table action menu could appear partially obscured by the edge of the page. ([#1084](https://github.com/simonw/datasette/issues/1084))",107914493,
https://github.com/simonw/datasette/releases/tag/0.52.1,34551688,MDc6UmVsZWFzZTM0NTUxNjg4,0.52.1,main,0.52.1,0,9599,0,2020-11-29T19:38:29Z,2020-11-29T19:39:52Z,"- Documentation on [Testing plugins](https://docs.datasette.io/en/stable/testing_plugins.html#testing-plugins) now recommends using [datasette.client](https://docs.datasette.io/en/stable/internals.html#internals-datasette-client). ([#1102](https://github.com/simonw/datasette/issues/1102))
- Fix bug where compound foreign keys produced broken links. ([#1098](https://github.com/simonw/datasette/issues/1098))
- `datasette --load-module=spatialite` now also checks for `/usr/local/lib/mod_spatialite.so`. Thanks, Dan Peterson. ([#1114](https://github.com/simonw/datasette/issues/1114))",107914493,
https://github.com/dogsheep/github-to-sqlite/releases/tag/2.8,34556308,MDc6UmVsZWFzZTM0NTU2MzA4,2.8,main,2.8,0,9599,0,2020-11-30T01:40:37Z,2020-11-30T01:41:38Z,"- New command: `github-to-sqlite workflows`, for fetching the YAML configuration used by [GitHub Actions](https://github.com/features/actions) workflows and using it to populate new `workflows`, `jobs` and `steps` tables. #54
- New command: `github-to-sqlite pull-requests` - thanks, @adamjonas! #48
- `github-to-sqlite issues --issue` option can now be used multiple times.",207052882,
https://github.com/dogsheep/github-to-sqlite/releases/tag/2.8.1,34558928,MDc6UmVsZWFzZTM0NTU4OTI4,2.8.1,main,2.8.1,0,9599,0,2020-11-30T04:16:41Z,2020-11-30T04:18:21Z,"- README now links to example database tables for each command. #56
- Added documentation for `github-to-sqlite releases`.",207052882,
https://github.com/simonw/datasette/releases/tag/0.52.2,34725716,MDc6UmVsZWFzZTM0NzI1NzE2,0.52.2,main,0.52.2,0,9599,0,2020-12-03T00:57:40Z,2020-12-03T00:58:43Z,"- Generated columns from SQLite 3.31.0 or higher are now correctly displayed. ([#1116](https://github.com/simonw/datasette/issues/1116))
- Error message if you attempt to open a SpatiaLite database now suggests using `--load-extension=spatialite` if it detects that the extension is available in a common location. ([#1115](https://github.com/simonw/datasette/issues/1115))
- `OPTIONS` requests against the `/database` page no longer raise a 500 error. ([#1100](https://github.com/simonw/datasette/issues/1100))
- Databases larger than 32MB that are published to Cloud Run can now be downloaded. ([#749](https://github.com/simonw/datasette/issues/749))
- Fix for misaligned cog icon on table and database pages. Thanks, Abdussamet Koçak. ([#1121](https://github.com/simonw/datasette/issues/1121))",107914493,
https://github.com/simonw/datasette/releases/tag/0.52.3,34782337,MDc6UmVsZWFzZTM0NzgyMzM3,0.52.3,main,0.52.3,0,9599,0,2020-12-03T19:07:05Z,2020-12-03T19:08:29Z,- Fixed bug where static assets would 404 for Datasette installed on ARM Amazon Linux. ([#1124](https://github.com/simonw/datasette/issues/1124>)),107914493,
https://github.com/simonw/datasette/releases/tag/0.52.4,34882011,MDc6UmVsZWFzZTM0ODgyMDEx,0.52.4,main,0.52.4,0,9599,0,2020-12-05T19:42:42Z,2020-12-05T19:42:57Z,"- Show [pysqlite3](https://github.com/coleifer/pysqlite3) version on `/-/versions`, if installed. ([#1125](https://github.com/simonw/datasette/issues/1125))
- Errors output by Datasette (e.g. for invalid SQL queries) now go to `stderr`, not `stdout`. ([#1131](https://github.com/simonw/datasette/issues/1131))
- Fix for a startup error on windows caused by unnecessary `from os import EX_CANTCREAT` - thanks, Abdussamet Koçak. ([#1094](https://github.com/simonw/datasette/issues/1094))",107914493,
https://github.com/simonw/datasette/releases/tag/0.53,35131848,MDc6UmVsZWFzZTM1MTMxODQ4,0.53,main,0.53,0,9599,0,2020-12-11T01:44:36Z,2020-12-11T01:46:44Z,"Datasette has an official project website now, at . This release mainly updates the documentation to reflect the new site.
- New `?column__arraynotcontains=` table filter. ([#1132](https://github.com/simonw/datasette/issues/1132))
- `datasette serve` has a new `--create` option, which will create blank database files if they do not already exist rather than exiting with an error. ([#1135](https://github.com/simonw/datasette/issues/1135))
- New `?_header=off` option for CSV export which omits the CSV header row, [documented here](https://docs.datasette.io/en/stable/csv_export.html#csv-export-url-parameters). ([#1133](https://github.com/simonw/datasette/issues/1133))
- ""Powered by Datasette"" link in the footer now links to . ([#1138](https://github.com/simonw/datasette/issues/1138))
- Project news no longer lives in the README - it can now be found at . ([#1137](https://github.com/simonw/datasette/issues/1137))",107914493,
https://github.com/simonw/sqlite-utils/releases/tag/3.1,35200016,MDc6UmVsZWFzZTM1MjAwMDE2,3.1,main,3.1,0,9599,0,2020-12-13T07:30:59Z,2020-12-13T07:31:40Z,"- New command: `sqlite-utils analyze-tables my.db` outputs useful information about the table columns in the database, such as the number of distinct values and how many rows are null. See [Analyzing tables](https://sqlite-utils.readthedocs.io/en/stable/cli.html#cli-analyze-tables) for documentation. ([#207](https://github.com/simonw/sqlite-utils/issues/207))
- New `table.analyze_column(column)` Python method used by the `analyze-tables` command - see [Analyzing a column](https://sqlite-utils.readthedocs.io/en/stable/python-api.html#python-api-analyze-column).
- The `table.update()` method now correctly handles values that should be stored as JSON. Thanks, Andreas Madsack. ([#204](https://github.com/simonw/sqlite-utils/pull/204))",140912432,
https://github.com/dogsheep/github-to-sqlite/releases/tag/2.8.2,35374715,MDc6UmVsZWFzZTM1Mzc0NzE1,2.8.2,main,2.8.2,0,9599,0,2020-12-16T19:20:36Z,2020-12-16T19:21:58Z,"- `--readme` now stores `null` if the README file does not exist, rather than throwing an error. #57
- README HTML is rewritten to fix broken internal links, e.g. for a table of contents. #58
",207052882,
https://github.com/dogsheep/dogsheep-beta/releases/tag/0.10,35382391,MDc6UmVsZWFzZTM1MzgyMzkx,0.10,main,0.10,0,9599,0,2020-12-16T21:27:04Z,2020-12-16T21:28:13Z,"- Now depends on [sqlite-utils](https://github.com/simonw/sqlite-utils) >= 3.0. #30
- The user's original search term is now passed to the `display_sql` SQL query as the `:q` parameter. #29
",197431109,
https://github.com/dogsheep/dogsheep-beta/releases/tag/0.10.1,35520026,MDc6UmVsZWFzZTM1NTIwMDI2,0.10.1,main,0.10.1,0,9599,0,2020-12-19T06:18:01Z,2020-12-19T06:19:13Z,- Fix for error if search query contains hyphens such as `github-to-sqlite`. #31 ,197431109,
https://github.com/simonw/sqlite-utils/releases/tag/3.1.1,35902315,MDc6UmVsZWFzZTM1OTAyMzE1,3.1.1,main,3.1.1,0,9599,0,2021-01-01T23:56:20Z,2021-01-01T23:57:07Z,"- Fixed failing test caused by `optimize` sometimes creating larger database files. ([#209](https://github.com/simonw/sqlite-utils/issues/209))
- Documentation now lives on
- README now includes `brew install sqlite-utils` installation method.",140912432,
https://github.com/simonw/sqlite-utils/releases/tag/3.2,35930040,MDc6UmVsZWFzZTM1OTMwMDQw,3.2,main,3.2,0,9599,0,2021-01-03T21:15:26Z,2021-01-03T21:17:37Z,"This release introduces a new mechanism for speeding up `count(*)` queries using cached table counts, stored in a `_counts` table and updated by triggers. This mechanism is described in [Cached table counts using triggers](https://sqlite-utils.datasette.io/en/stable/python-api.html#python-api-cached-table-counts), and can be enabled using Python API methods or the new `enable-counts` CLI command. ([#212](https://github.com/simonw/sqlite-utils/issues/212))
- `table.enable_counts()` method for enabling these triggers on a specific table.
- `db.enable_counts()` method for enabling triggers on every table in the database. ([#213](https://github.com/simonw/sqlite-utils/issues/213))
- New `sqlite-utils enable-counts my.db` command for enabling counts on all or specific tables, see [Enabling cached counts](https://sqlite-utils.datasette.io/en/stable/cli.html#cli-enable-counts). ([#214](https://github.com/simonw/sqlite-utils/issues/214))
- New `sqlite-utils triggers` command for listing the triggers defined for a database or specific tables, see [Listing triggers](https://sqlite-utils.datasette.io/en/stable/cli.html#cli-triggers). ([#218](https://github.com/simonw/sqlite-utils/issues/218))
- New `db.use_counts_table` property which, if `True`, causes `table.count` to read from the `_counts` table. ([#215](https://github.com/simonw/sqlite-utils/issues/215))
- `table.has_counts_triggers` property revealing if a table has been configured with the new `_counts` database triggers.
- `db.reset_counts()` method and `sqlite-utils reset-counts` command for resetting the values in the `_counts` table. ([#219](https://github.com/simonw/sqlite-utils/issues/219))
- The previously undocumented `db.escape()` method has been renamed to `db.quote()` and is now covered by the documentation: [Quoting strings for use in SQL](https://sqlite-utils.datasette.io/en/stable/python-api.html#python-api-quote). ([#217](https://github.com/simonw/sqlite-utils/issues/217))
- New `table.triggers_dict` and `db.triggers_dict` introspection properties. ([#211](https://github.com/simonw/sqlite-utils/issues/211), [#216](https://github.com/simonw/sqlite-utils/issues/216))
- `sqlite-utils insert` now shows a more useful error message for invalid JSON. ([#206](https://github.com/simonw/sqlite-utils/issues/206))",140912432,
https://github.com/simonw/sqlite-utils/releases/tag/3.2.1,36307444,MDc6UmVsZWFzZTM2MzA3NDQ0,3.2.1,main,3.2.1,0,9599,0,2021-01-12T23:22:53Z,2021-01-12T23:23:25Z,- Fixed a bug where `.add_missing_columns()` failed to take case insensitive column names into account. ([#221](https://github.com/simonw/sqlite-utils/issues/221)),140912432,
https://github.com/simonw/sqlite-utils/releases/tag/3.3,36530216,MDc6UmVsZWFzZTM2NTMwMjE2,3.3,main,3.3,0,9599,0,2021-01-18T04:28:24Z,2021-01-18T04:29:48Z,- The `table.m2m()` method now accepts an optional `alter=True` argument to specify that any missing columns should be added to the referenced table. See [Working with many-to-many relationships](https://sqlite-utils.datasette.io/en/stable/python-api.html#python-api-m2m). ([#222](https://github.com/simonw/sqlite-utils/issues/222)),140912432,
https://github.com/dogsheep/swarm-to-sqlite/releases/tag/0.3.3,36530359,MDc6UmVsZWFzZTM2NTMwMzU5,0.3.3,main,0.3.3,0,9599,0,2021-01-18T04:34:56Z,2021-01-18T04:36:03Z,- Fixed bug where tool could crash with an error about missing columns. #11,205429375,
https://github.com/simonw/datasette/releases/tag/0.54,36871901,MDc6UmVsZWFzZTM2ODcxOTAx,0.54,main,0.54,0,9599,0,2021-01-25T17:35:06Z,2021-01-25T17:36:30Z,"The two big new features in this release are the `_internal` SQLite in-memory database storing details of all connected databases and tables, and support for JavaScript modules in plugins and additional scripts.
For additional commentary on this release, see [Datasette 0.54, the annotated release notes](https://simonwillison.net/2021/Jan/25/datasette/).
### The _internal database
As part of ongoing work to help Datasette handle much larger numbers of connected databases and tables (see [Datasette Library](https://github.com/simonw/datasette/issues/417)) Datasette now maintains an in-memory SQLite database with details of all of the attached databases, tables, columns, indexes and foreign keys. ([#1150](https://github.com/simonw/datasette/issues/1150))
This will support future improvements such as a searchable, paginated homepage of all available tables.
You can explore an example of this database by [signing in as root](https://latest.datasette.io/login-as-root) to the `latest.datasette.io` demo instance and then navigating to [latest.datasette.io/_internal](https://latest.datasette.io/_internal).
Plugins can use these tables to introspect attached data in an efficient way. Plugin authors should note that this is not yet considered a stable interface, so any plugins that use this may need to make changes prior to Datasette 1.0 if the `_internal` table schemas change.
### Named in-memory database support
As part of the work building the `_internal` database, Datasette now supports named in-memory databases that can be shared across multiple connections. This allows plugins to create in-memory databases which will persist data for the lifetime of the Datasette server process. ([#1151](https://github.com/simonw/datasette/issues/1151))
The new `memory_name=` parameter to the [Database class](https://docs.datasette.io/en/stable/internals.html#internals-database) can be used to create named, shared in-memory databases.
### JavaScript modules
[JavaScript modules](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Guide/Modules) were introduced in ECMAScript 2015 and provide native browser support for the `import` and `export` keywords.
To use modules, JavaScript needs to be included in ` |