summaryrefslogtreecommitdiffstats
path: root/lib/Fetcher
AgeCommit message (Collapse)Author
2021-01-20Fetcher: Update client and add testSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2021-01-12Fix psalm issuesSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-12-30Remove PHPunit integration testsSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-12-15Remove LastModified-based cursor when updating feedsKevin Decherf
We remove the call to readSince() as some feeds push new articles with pubDate prior to the lastModified time stored for these feeds (e.g. lemonde.fr). As we go through all items of a feed again and again, we prevent the constant update of an item's lastModified timestamp by keeping the previous one if its fingerprint does not change. Fixes #921 Signed-off-by: Kevin Decherf <kevin@kdecherf.com>
2020-11-07remove deprecated YouTube playlist APIanoy
Signed-off-by: anoy <anoymouserver+github@mailbox.org>
2020-10-12Allow titles to be nullSean Molenaar
Issue GH-867 Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-29Add feed autodiscoverySean Molenaar
Issue GH-415 Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-29OPML export command and fixesSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-29Fix repair step and test itSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-27Create V2 mapper, Service and management commandsSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-25Move to nextcloud config and update phpunitSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-08-31Fix crash if full-text is enabled and the news item does not provide an URL ↵Gioele Falcetti
to be fetched Signed-off-by: Gioele Falcetti <thegio.f@gmail.com>
2020-04-28fix 'If-Modified-Since' causing BAD REQUEST (#684)Chris Noxz
fix 'If-Modified-Since' causing BAD REQUEST Signed-off-by: Chris Noxz <chris@noxz.tech> Co-authored-by: kesselb <mail@danielkesselberg.de>
2020-02-16Basic Media-RSS support (#599)Éloi Rivard
Signed-off-by: Éloi Rivard <azmeuk@gmail.com>
2019-12-27Update httpLastModified from the feed response (#594)kesselb
LastModified is used (in a feed context to see if a user edited a feed). httpLastModified to store the last-modified response from the source. Signed-off-by: Daniel Kesselberg <mail@danielkesselberg.de>
2019-12-24Reimplement full-text scraping (#563)DriverXX
Add readability.php scraper Fixes #482 Signed-off-by: Gioele Falcetti <thegio.f@gmail.com>
2019-11-16Get content:encoded of item if available (#565)b_b
Get content:encoded of item if available fixes #564 Signed-off-by: brunob <bruno@eliaz.fr>
2019-08-16Update to feedio 4+ (#494)Benjamin Brahmer
- bumped dependencies to last supported version travis: - removed php 7.0 - move main target to nc 16 - drop support for nc 14 & 15 Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2019-03-26Fix xkcd commicsSean Molenaar
2019-03-22Stop assuming encoding of xml, let simplexml throw silently (#457)Sean Molenaar
2019-03-21Allow empty-ish lastmodified and clean up FeedFetcher Test (#458)Sean Molenaar
2019-03-20reset modified since filter when updating feedsJasper Knockaert
When updating feeds the modified since date is added as a filter. This needs to be reset when looping over the feeds. Fixes #444.
2019-03-18Use a copy of the FeedIO client that doesn't specify a useragentSean Molenaar
2019-03-17fix/allow CDATA encoding (#428)Sean Molenaar
2019-03-12Fix email and password not being encodedSean Molenaar
2019-03-12Catch FeedIO reader exception.Sean Molenaar
Closes #413 Closes #412
2019-02-23Allow empty update timeSean Molenaar
2019-01-31Fix mismatched interfaceSean Molenaar
2019-01-31Make feed failing more verboseSean Molenaar
2019-01-30Parser: Switch to feedIO for parsing instead of picoFeedSean Molenaar
2018-12-14Define an official codestyle and adhere to it.Sean Molenaar
2018-03-27Core: Fix compatibility with nextcloud codestyle (#280)Sean Molenaar
2017-08-14Split binary to booleans (#203)Daniel Opitz
* replaced old status with 2 flags for unread and starred * add fields to db, replace int(1,0) with booleans in sql queries, removed StatusFlags class + refactor code relying to it * add repair step for migration * again use integer(1,0) instead of bool in sql queries, because of sqlite doesn't support true/false * add/fix unit tests for new boolean status * set unread/starred flags as statements in sql * fixed mysql unknown column items.unread, fixed marking of read items on repair step * remove unnecessary bool casts * add empty checks to Items::is* methods * update migration to use native sql instead of the querybuilder * don't cast the flags manually, let the api do the work
2017-07-13Rakekniven patch 1 (#204)rakekniven
* Update FeedFetcher.php * Update part.content.warnings.php * Update part.content.warnings.php
2017-07-09Update FeedFetcher.php (#200)rakekniven
Small l10n fix
2017-01-04Add postprocessor for getting lwn subscriber articles (#72)Robin Appelman
2017-01-04Add updatedDate to item model (#81)Daniel Schaal
* Update picoFeed to v0.1.28 * Add updated_date to database and bump version to 10.1.1 * Add updatedDate to item model * Check for updatedDate when updating a feed * Fix unit test to check for newer updatedDate
2016-10-02revertBernhard Posselt
2016-10-01Add updatedDate to item model (#43)Daniel Schaal
* Update picoFeed to 0.1.25 * Add updated_date to database * Add updatedDate to item model * Bump version to 9.0.5 * Check for updatedDate when updating a feed * Fix unit test to check for newer updatedDate
2016-07-23Adjust copyright headerBernhard Posselt
2016-07-23Move to new directory structureBernhard Posselt