Commit Graph
57 Commits
Author SHA1 Message Date
Brandon Thomas 2c9be7c262 fix aspect ratio controls on image gen (first pass) (#723)
This doesn't support all aspect ratios for all models. We'll need to
come back and offer per-model options.
2025-07-14 21:51:32 -04:00
Brandon Thomas b3a62cce64 refactor packages 2025-05-25 22:09:59 -04:00
Brandon Thomas 8845b177be rename workspace hack 2025-04-09 20:39:36 -04:00
Brandon Thomas ce0448edca move rust code back to root directory 2025-02-11 21:58:04 -05:00
Brandon Thomas 495b161cae move storyteller-rust files into subdir for merge 2025-02-11 21:09:22 -05:00
Brandon Thomas 31733b2063 upgrade reqwest 2024-06-16 15:57:55 -04:00
Brandon Thomas cd848319eb update more dependencies 2024-06-16 14:41:22 -04:00
dependabot[bot] dbf724c15a Bump bytes from 1.5.0 to 1.6.0 (#333)
Bumps [bytes](https://github.com/tokio-rs/bytes) from 1.5.0 to 1.6.0.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/tokio-rs/bytes/releases">bytes's
releases</a>.</em></p>
<blockquote>
<h2>Bytes 1.6.0 (March 22, 2024)</h2>
<h3>Added</h3>
<ul>
<li>Add <code>Bytes::is_unique</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/643">#643</a>)</li>
</ul>
<h3>Documented</h3>
<ul>
<li>Fix changelog typo (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/628">#628</a>)</li>
<li>Fix some spelling mistakes (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/633">#633</a>)</li>
<li>Typo fix (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/637">#637</a>)</li>
<li>Fix broken links (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/639">#639</a>)</li>
<li>Add security policy (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/649">#649</a>)</li>
</ul>
<h3>Internal changes</h3>
<ul>
<li>Move comment to correct constant (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/629">#629</a>)</li>
<li>Various cleanup (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/635">#635</a>)</li>
<li>Simplify <code>UninitSlice::as_uninit_slice_mut()</code> logic (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/644">#644</a>)</li>
<li>Use <code>self.</code> instead of <code>Self::</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/642">#642</a>)</li>
<li><code>BytesMut</code>: Assert alignment of <code>Shared</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/652">#652</a>)</li>
<li>Remove unnecessary namespace qualifier (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/660">#660</a>)</li>
<li>Remove an unnecessary else branch (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/662">#662</a>)</li>
<li>Remove unreachable else branch (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/661">#661</a>)</li>
<li>make parameter mut in <code>From&lt;Vec&gt;</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/667">#667</a>)</li>
<li>Restore commented tests (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/665">#665</a>)</li>
<li>Use <code>sub</code> instead of <code>offset</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/668">#668</a>)</li>
<li>Calculate original capacity only if necessary (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/666">#666</a>)</li>
<li><code>set_vec_pos</code> does not need a second parameter (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/672">#672</a>)</li>
<li><code>get_vec_pos</code>: use <code>&amp;self</code> instead of
<code>&amp;mut self</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/670">#670</a>)</li>
<li>Refactor <code>split_at</code>/<code>split_to</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/663">#663</a>)</li>
<li>Use <code>Iterator</code> from the prelude (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/673">#673</a>)</li>
<li><code>copy_to_bytes</code>: Add panic section to docs (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/676">#676</a>)</li>
<li>Remove redundant reserve call (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/674">#674</a>)</li>
<li>Use <code>ManuallyDrop</code> instead of <code>mem::forget</code>
(<a
href="https://redirect.github.com/tokio-rs/bytes/issues/675">#675</a>)</li>
</ul>
</blockquote>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a
href="https://github.com/tokio-rs/bytes/blob/master/CHANGELOG.md">bytes's
changelog</a>.</em></p>
<blockquote>
<h1>1.6.0 (March 22, 2024)</h1>
<h3>Added</h3>
<ul>
<li>Add <code>Bytes::is_unique</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/643">#643</a>)</li>
</ul>
<h3>Documented</h3>
<ul>
<li>Fix changelog typo (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/628">#628</a>)</li>
<li>Fix some spelling mistakes (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/633">#633</a>)</li>
<li>Typo fix (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/637">#637</a>)</li>
<li>Fix broken links (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/639">#639</a>)</li>
<li>Add security policy (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/649">#649</a>)</li>
</ul>
<h3>Internal changes</h3>
<ul>
<li>Move comment to correct constant (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/629">#629</a>)</li>
<li>Various cleanup (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/635">#635</a>)</li>
<li>Simplify <code>UninitSlice::as_uninit_slice_mut()</code> logic (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/644">#644</a>)</li>
<li>Use <code>self.</code> instead of <code>Self::</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/642">#642</a>)</li>
<li><code>BytesMut</code>: Assert alignment of <code>Shared</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/652">#652</a>)</li>
<li>Remove unnecessary namespace qualifier (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/660">#660</a>)</li>
<li>Remove an unnecessary else branch (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/662">#662</a>)</li>
<li>Remove unreachable else branch (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/661">#661</a>)</li>
<li>make parameter mut in <code>From&lt;Vec&gt;</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/667">#667</a>)</li>
<li>Restore commented tests (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/665">#665</a>)</li>
<li>Use <code>sub</code> instead of <code>offset</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/668">#668</a>)</li>
<li>Calculate original capacity only if necessary (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/666">#666</a>)</li>
<li><code>set_vec_pos</code> does not need a second parameter (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/672">#672</a>)</li>
<li><code>get_vec_pos</code>: use <code>&amp;self</code> instead of
<code>&amp;mut self</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/670">#670</a>)</li>
<li>Refactor <code>split_at</code>/<code>split_to</code> (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/663">#663</a>)</li>
<li>Use <code>Iterator</code> from the prelude (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/673">#673</a>)</li>
<li><code>copy_to_bytes</code>: Add panic section to docs (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/676">#676</a>)</li>
<li>Remove redundant reserve call (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/674">#674</a>)</li>
<li>Use <code>ManuallyDrop</code> instead of <code>mem::forget</code>
(<a
href="https://redirect.github.com/tokio-rs/bytes/issues/675">#675</a>)</li>
</ul>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/tokio-rs/bytes/commit/ce8d8a0a029c0d296ade752ecc8c3e1ce9eee47f"><code>ce8d8a0</code></a>
chore: prepare bytes v1.6.0 (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/681">#681</a>)</li>
<li><a
href="https://github.com/tokio-rs/bytes/commit/536db06f168bdef967afbeac0561bf774e9a1315"><code>536db06</code></a>
Use ManuallyDrop instead of mem::forget (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/675">#675</a>)</li>
<li><a
href="https://github.com/tokio-rs/bytes/commit/ca004117f86afccd36148dee7c8413cfaf9de6a4"><code>ca00411</code></a>
Remove commented tests for Bytes::unsplit (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/677">#677</a>)</li>
<li><a
href="https://github.com/tokio-rs/bytes/commit/7968f6f83d17175683e04ce56aa48e44ed7d0d98"><code>7968f6f</code></a>
Remove redundant reserve call (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/674">#674</a>)</li>
<li><a
href="https://github.com/tokio-rs/bytes/commit/c5fae00c76dbd1af7ea7b6cde7a9281d82ee7cd2"><code>c5fae00</code></a>
copy_to_bytes: Add panic section to docs (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/676">#676</a>)</li>
<li><a
href="https://github.com/tokio-rs/bytes/commit/99584cc10d66cb6880a20c5ac9b9a960f9c17823"><code>99584cc</code></a>
Use Iterator from the prelude (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/673">#673</a>)</li>
<li><a
href="https://github.com/tokio-rs/bytes/commit/46289278f52a26c12298779f4aaebad1dcb26d35"><code>4628927</code></a>
Refactor split_at/split_to (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/663">#663</a>)</li>
<li><a
href="https://github.com/tokio-rs/bytes/commit/1bcd2129d195a0722d8b5b1a16c7d33698701f2e"><code>1bcd212</code></a>
get_vec_pos: use &amp;self instead of &amp;mut self (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/670">#670</a>)</li>
<li><a
href="https://github.com/tokio-rs/bytes/commit/f586ffc52589f01be1b4a44d6544b3d0226773d6"><code>f586ffc</code></a>
set_vec_pos does not need a second parameter (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/672">#672</a>)</li>
<li><a
href="https://github.com/tokio-rs/bytes/commit/c6972d61328be113ec8e80c207815a4b84fe616c"><code>c6972d6</code></a>
Calculate original capacity only if necessary (<a
href="https://redirect.github.com/tokio-rs/bytes/issues/666">#666</a>)</li>
<li>Additional commits viewable in <a
href="https://github.com/tokio-rs/bytes/compare/v1.5.0...v1.6.0">compare
view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=bytes&package-manager=cargo&previous-version=1.5.0&new-version=1.6.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-27 23:47:29 -04:00
Brandon Thomas fd1a37d7f3 mark dependencies 2024-05-16 08:01:52 -07:00
Brandon Thomas f812fbb4e6 rust lint: unused mut 2024-01-20 18:40:15 -05:00
Brandon Thomas dca8ff7014 deprecated lint; clarify serde casing 2024-01-11 19:09:38 -05:00
Brandon Thomas e18b86a55a everything needs to refer to workplace-hack 2023-12-08 01:25:49 -05:00
Brandon Thomas 8a6678c7f5 move workspace-hack under crates/ 2023-12-06 02:12:57 -05:00
Brandon Thomas fc122cb996 upgrade chrono with vendored limitation 2023-12-05 21:54:06 -05:00
Brandon Thomas 92e0b1e9f4 Revert "Bump chrono from 0.4.22 to 0.4.31"
This reverts commit 4856ac28aa.
2023-12-05 20:40:09 -05:00
dependabot[bot] 4856ac28aa Bump chrono from 0.4.22 to 0.4.31
Bumps [chrono](https://github.com/chronotope/chrono) from 0.4.22 to 0.4.31.
- [Release notes](https://github.com/chronotope/chrono/releases)
- [Changelog](https://github.com/chronotope/chrono/blob/main/CHANGELOG.md)
- [Commits](https://github.com/chronotope/chrono/compare/v0.4.22...v0.4.31)

---
updated-dependencies:
- dependency-name: chrono
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-12-06 00:19:36 +00:00
Brandon Thomas bd4644098f Upgrade sqlx to latest (0.7.2)
Hypothetically this unblocks native rustls over IP address. If so, we
can drop native OpenSSL and Ubuntu packages and make a much simpler
build.

See this issue:
https://github.com/launchbadge/sqlx/issues/1095#issuecomment-798050828

Had to deal with a few migration issues,

- changes to transactor types:
  https://github.com/launchbadge/sqlx/issues/2606

- changes to sqlx_core that impacted our serialization/deserialization macros
2023-11-19 23:25:52 -05:00
Brandon Thomas bc94582138 Merge pull request #140 from storytold/dependabot/cargo/strum-0.25.0
Bump strum from 0.24.1 to 0.25.0
2023-11-16 17:56:18 -05:00
dependabot[bot] 59c19b2927 Bump strum from 0.24.1 to 0.25.0
Bumps [strum](https://github.com/Peternator7/strum) from 0.24.1 to 0.25.0.
- [Changelog](https://github.com/Peternator7/strum/blob/master/CHANGELOG.md)
- [Commits](https://github.com/Peternator7/strum/commits)

---
updated-dependencies:
- dependency-name: strum
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-16 06:18:28 +00:00
dependabot[bot] 3adf92d4e5 Bump serde_json from 1.0.91 to 1.0.108
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.91 to 1.0.108.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.91...v1.0.108)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-16 06:17:36 +00:00
kasisnu 2eb5635c58 removing some unused creates 2023-11-14 12:31:37 +05:30
dependabot[bot] f9caa7d836 Bump scraper from 0.14.0 to 0.17.1
Bumps [scraper](https://github.com/causal-agent/scraper) from 0.14.0 to 0.17.1.
- [Release notes](https://github.com/causal-agent/scraper/releases)
- [Commits](https://github.com/causal-agent/scraper/compare/v0.14.0...v0.17.1)

---
updated-dependencies:
- dependency-name: scraper
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-16 22:17:50 +00:00
dependabot[bot] 589d13fdd1 Bump once_cell from 1.17.0 to 1.18.0
Bumps [once_cell](https://github.com/matklad/once_cell) from 1.17.0 to 1.18.0.
- [Changelog](https://github.com/matklad/once_cell/blob/master/CHANGELOG.md)
- [Commits](https://github.com/matklad/once_cell/compare/v1.17.0...v1.18.0)

---
updated-dependencies:
- dependency-name: once_cell
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-10-04 05:56:02 +00:00
Brandon Thomas 699bb6a6a7 Clion auto-optimize imports, remove dead imports, Clippy lint 2023-09-20 01:39:58 -04:00
Brandon Thomas 226fb93a36 lint progress 2023-08-16 02:28:48 -04:00
Brandon Thomas f41833e4f4 cargo cranky: &'static 2023-08-15 23:56:03 -04:00
Brandon Thomas 27adc9f73e gizmodo + kotaku in app scraping 2023-02-24 03:41:12 -05:00
Brandon Thomas 6d082f2b9e Kotaku + Gizmodo RSS indexers 2023-02-24 03:18:00 -05:00
Brandon Thomas 2c86a4189c kotaku scraper 2023-02-24 02:49:02 -05:00
Brandon Thomas bf5b2b385e CNN timestamps 2023-02-24 02:33:37 -05:00
Brandon Thomas b7c73930b4 CNN timestamps 2023-02-24 02:20:36 -05:00
Brandon Thomas f9d61a1482 Gizmodo scraper 2023-02-24 01:50:08 -05:00
Brandon Thomas 4799d3ceac CBS News scraper 2023-02-24 01:21:29 -05:00
Brandon Thomas 696fd2bd8d Add timestamp to theguardian scraper 2023-02-24 00:45:10 -05:00
Brandon Thomas 1cfb3bb715 TheGuardian scraper 2023-02-23 19:21:19 -05:00
Brandon Thomas ccb36f7f6e CLI utility to test parsing 2023-02-23 18:57:23 -05:00
Brandon Thomas 1e7de6bf36 hanashi v2, include cnn entertainment feed 2023-02-19 06:35:22 -05:00
Brandon Thomas 486960905d Add web_content_type to news_stories and news_story_productions 2023-02-19 05:57:36 -05:00
Brandon Thomas 6c33c31289 skip CNN video content 2023-02-08 05:13:45 -05:00
Brandon Thomas 5878224f7e rendition schema 2023-02-07 22:40:35 -05:00
Brandon Thomas 5497b7c0aa small refactor 2023-02-07 18:54:23 -05:00
Brandon Thomas bc58b50408 shared title/image extractors 2023-02-07 17:50:58 -05:00
Brandon Thomas ce17a3e1bf CNN articles, shared extractors 2023-02-07 17:13:07 -05:00
Brandon Thomas d41cec6c90 cleanup log spam 2023-02-07 02:24:44 -05:00
Brandon Thomas 4f7d03a505 index cnn + techcrunch 2023-02-06 04:56:49 -05:00
Brandon Thomas d1b6facd95 worker threads 2023-02-06 04:46:10 -05:00
Brandon Thomas 8ff2408cbf begin to work on persisting scraping 2023-02-06 02:47:21 -05:00
Brandon Thomas 01fa2f8d67 serde 2023-02-05 17:35:44 -05:00
Brandon Thomas 25b7024655 title, more fields 2023-02-05 17:32:29 -05:00
Brandon Thomas f7b8423623 techcrunch parsing sort of works 2023-02-05 16:29:17 -05:00