summaryrefslogtreecommitdiffstats
path: root/lib/Fetcher
AgeCommit message (Collapse)Author
2021-11-30Fix catching connect exceptions while fetching feed logos #1570Michael Hamann
Display the message instead of the response when catching an exception during feed logo fetching. As there is no response and thus no method `getResponse()` in `ConnectException`, this fixes a "call to undefined method"-error that prevented feeds from fetching if fetching the logo resulted in a `ConnectException`. Signed-off-by: Michael Hamann <michael@content-space.de>
2021-11-14Catch network errors while fetching feed logos, fixes #1570Benjamin Brahmer
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-10-18Smarter error logging Benjamin Brahmer
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de> Co-authored-by: Sean Molenaar <SMillerDev@users.noreply.github.com>
2021-10-18make use of constant Benjamin Brahmer
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de> Co-authored-by: Sean Molenaar <SMillerDev@users.noreply.github.com>
2021-10-18make use of base_url to handle relative urlsBenjamin Brahmer
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-10-18Download feed logos via guzzle to have better error handlingBenjamin Brahmer
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-05-03[Backport] Prevent some of the favicon fetching errorsBenjamin Brahmer
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-04-24replace deprecated getDescription callanoy
Signed-off-by: anoy <anoymouserver+github@mailbox.org>
2021-04-08Null check category label before trying to decode (#1282)Chris Danser
* Null check category label before trying to decode Signed-off-by: skiingwiz <skiingwiz@gmail.com>
2021-03-25Make PHPstan stricterSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2021-03-17🎨 Item: store categories as json & add helper fnsMarco Nassabain
+ added setter/getters that work with arrays to simplify use case Signed-off-by: Marco Nassabain <marco.nassabain@hotmail.com>
2021-03-17♻️ Renaming 'tags' into 'categories'Jimmy Huynh
Signed-off-by: Jimmy Huynh <jimmy.huynh@etu.unistra.fr>
2021-03-17✨ Update FeedFetcher: import 'tags' to 'item'Jimmy Huynh
Signed-off-by: Jimmy Huynh <jimmy.huynh@etu.unistra.fr>
2021-02-16remove unused lastModified from feed fetcherBenjamin Brahmer
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-02-16prefer the feeds logo over the faviconBenjamin Brahmer
The logo of the feed is prefered if it is a square picture, else the favicon is returned. Signed-off-by: Benjamin Brahmer <info@b-brahmer.de> Co-authored-by: Sean Molenaar <SMillerDev@users.noreply.github.com>
2021-02-13Remove V1 item APISean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2021-01-20Fetcher: Update client and add testSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2021-01-12Fix psalm issuesSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-12-30Remove PHPunit integration testsSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-12-15Remove LastModified-based cursor when updating feedsKevin Decherf
We remove the call to readSince() as some feeds push new articles with pubDate prior to the lastModified time stored for these feeds (e.g. lemonde.fr). As we go through all items of a feed again and again, we prevent the constant update of an item's lastModified timestamp by keeping the previous one if its fingerprint does not change. Fixes #921 Signed-off-by: Kevin Decherf <kevin@kdecherf.com>
2020-11-07remove deprecated YouTube playlist APIanoy
Signed-off-by: anoy <anoymouserver+github@mailbox.org>
2020-10-12Allow titles to be nullSean Molenaar
Issue GH-867 Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-29Add feed autodiscoverySean Molenaar
Issue GH-415 Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-29OPML export command and fixesSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-29Fix repair step and test itSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-27Create V2 mapper, Service and management commandsSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-25Move to nextcloud config and update phpunitSean Molenaar
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-08-31Fix crash if full-text is enabled and the news item does not provide an URL ↵Gioele Falcetti
to be fetched Signed-off-by: Gioele Falcetti <thegio.f@gmail.com>
2020-04-28fix 'If-Modified-Since' causing BAD REQUEST (#684)Chris Noxz
fix 'If-Modified-Since' causing BAD REQUEST Signed-off-by: Chris Noxz <chris@noxz.tech> Co-authored-by: kesselb <mail@danielkesselberg.de>
2020-02-16Basic Media-RSS support (#599)Éloi Rivard
Signed-off-by: Éloi Rivard <azmeuk@gmail.com>
2019-12-27Update httpLastModified from the feed response (#594)kesselb
LastModified is used (in a feed context to see if a user edited a feed). httpLastModified to store the last-modified response from the source. Signed-off-by: Daniel Kesselberg <mail@danielkesselberg.de>
2019-12-24Reimplement full-text scraping (#563)DriverXX
Add readability.php scraper Fixes #482 Signed-off-by: Gioele Falcetti <thegio.f@gmail.com>
2019-11-16Get content:encoded of item if available (#565)b_b
Get content:encoded of item if available fixes #564 Signed-off-by: brunob <bruno@eliaz.fr>
2019-08-16Update to feedio 4+ (#494)Benjamin Brahmer
- bumped dependencies to last supported version travis: - removed php 7.0 - move main target to nc 16 - drop support for nc 14 & 15 Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2019-03-26Fix xkcd commicsSean Molenaar
2019-03-22Stop assuming encoding of xml, let simplexml throw silently (#457)Sean Molenaar
2019-03-21Allow empty-ish lastmodified and clean up FeedFetcher Test (#458)Sean Molenaar
2019-03-20reset modified since filter when updating feedsJasper Knockaert
When updating feeds the modified since date is added as a filter. This needs to be reset when looping over the feeds. Fixes #444.
2019-03-18Use a copy of the FeedIO client that doesn't specify a useragentSean Molenaar
2019-03-17fix/allow CDATA encoding (#428)Sean Molenaar
2019-03-12Fix email and password not being encodedSean Molenaar
2019-03-12Catch FeedIO reader exception.Sean Molenaar
Closes #413 Closes #412
2019-02-23Allow empty update timeSean Molenaar
2019-01-31Fix mismatched interfaceSean Molenaar
2019-01-31Make feed failing more verboseSean Molenaar
2019-01-30Parser: Switch to feedIO for parsing instead of picoFeedSean Molenaar
2018-12-14Define an official codestyle and adhere to it.Sean Molenaar
2018-03-27Core: Fix compatibility with nextcloud codestyle (#280)Sean Molenaar
2017-08-14Split binary to booleans (#203)Daniel Opitz
* replaced old status with 2 flags for unread and starred * add fields to db, replace int(1,0) with booleans in sql queries, removed StatusFlags class + refactor code relying to it * add repair step for migration * again use integer(1,0) instead of bool in sql queries, because of sqlite doesn't support true/false * add/fix unit tests for new boolean status * set unread/starred flags as statements in sql * fixed mysql unknown column items.unread, fixed marking of read items on repair step * remove unnecessary bool casts * add empty checks to Items::is* methods * update migration to use native sql instead of the querybuilder * don't cast the flags manually, let the api do the work
2017-07-13Rakekniven patch 1 (#204)rakekniven
* Update FeedFetcher.php * Update part.content.warnings.php * Update part.content.warnings.php