c32e312061
More robust PuSH subscription refreshes ( #2799 )
...
* Fix #2473 - Use sidekiq scheduler to refresh PuSH subscriptions instead of cron
Fix an issue where / in domain would raise exception in TagManager#normalize_domain
PuSH subscriptions refresh done in a round-robin way to avoid hammering a single
server's hub in sequence. Correct handling of failures/retries through Sidekiq (see
also #2613 ). Optimize Account#with_followers scope. Also, since subscriptions
are now delegated to Sidekiq jobs, an uncaught exception will not stop the entire
refreshing operation halfway through
Fix #2702 - Correct user agent header on outgoing http requests
* Add test for SubscribeService
* Extract #expiring_accounts into method
* Make mastodon:push:refresh no-op
* Queues are now defined in sidekiq.yml
* Queues are now in sidekiq.yml
2017-05-05 02:23:01 +02:00
a206fa8037
Delete records in smaller transaction ( #2802 )
2017-05-04 23:44:39 +02:00
93ec05f976
Decode IDNA in PreviewCard ( #2781 )
2017-05-04 15:52:08 +02:00
78df86a7c8
Likely fix #2458 , fix #2031 - handle out-of-order deletes for statuses ( #2734 )
...
* Likely fix #2458 , fix #2031 - handle out-of-order deletes for statuses
If a delete arrives before the original status, cache that information
for 6h, and if the original status arrives in that window, ignore it
* Add test case
2017-05-04 04:34:57 +02:00
91a8a5eab8
Fix #2706 - Always respond with 200 to PuSH payloads ( #2733 )
...
Fix #2196 - Respond with 201 when Salmon accepted, 400 when unverified
Fix #2629 - Correctly handle confirm_domain? for local accounts
Unify rules for extracting author acct from XML, prefer <email>, fall back
to <name> + <uri> (see also #2017 , #2172 )
2017-05-03 17:02:18 +02:00
7c65bcbdb7
Downgrade rubocop 0.48.1 => 0.46.0 ( #2628 )
...
* downgrade rubocop 0.48.1 => 0.46.0
* exclude vendor/**/* from rubocop target files
* add frozen_string_literal comment line
* fix percent literal delimited by ( and )
* fix alignment
* remove comment disabling unknown cop
2017-04-30 00:23:45 +02:00
ae0c77c5d1
Set unknown attachment type when adding domain blocks ( #2605 )
...
Follow-up to #2599 . When a domain block with `reject_media` is
added or `rake mastodon:media:remove_remote` is invoked, mastodon
deletes the locally cached attachments and avatars but does not
reflect that change in the database, causing the `file` fields to
still have values. This change persists the deletion in the
database and sets the attachment type to unknown.
This also introduces a one-off rake task that sets all attachments
without a local file to the "unknown" type. The upgrade notes for
the next release should contain a post-upgrade step with
`rake mastodon:media:set_unknown`.
2017-04-29 02:44:03 +02:00
97dff125a8
Improve shared status verification ( #2525 )
...
* Instead of parsing shared status contents verbatim, make roundtrip
to purported original URL. Confirm that the "original" URL is from the
same domain as the author it claims to be from.
* Fix obvious typo, add comment
* Use URI look-up first
* Add test, update Goldfinger dependency to make less useless HTTP requests per Webfinger lookup
2017-04-27 17:06:47 +02:00
4a7dc4fadc
OEmbed support for PreviewCard ( #2337 )
...
* OEmbed support for PreviewCard
* Improve ProviderDiscovery code failure treatment
* Do not crawl links if there is a content warning, since those
don't display a link card anyway
* Reset db schema
* Fresh migrate
* Fix rubocop style issues
Fix #1681 - return existing access token when applicable instead of creating new
* Fix test
* Extract http client to helper
* Improve oembed controller
2017-04-27 14:42:22 +02:00
89255db0d8
Domain block service cleanup ( #2490 )
...
* Add coverage for domain block service with silence
* Get rid of warning about find_each and order
* Move domain_block to attr_reader
* Move optional clear_media into silence_accounts method
* Use blocked_domain method to reduce passed vars
* Extract blocked_domain_accounts method to find accounts on the domain
* Extract media_from_blocked_domain method to find relevant attachments
* Separate destruction of account images and account attachments
2017-04-26 20:09:01 +02:00
8e7c858877
attach_media should be in transaction of creation status ( #2426 )
2017-04-26 03:47:44 +02:00
553d6a1ea6
Fix #2402 - Add Idempotency-Key header to PostStatusService that prevents ( #2419 )
...
duplicates. Web UI regenerates UUID for that header every time the compose
form is changed or successfully submitted
Also, fix Farsi i18n overwriting the English one
2017-04-25 15:04:49 +02:00
1b6e534850
Optimize account search ( #2421 )
2017-04-25 04:44:43 +02:00
87f7a3922c
Punycode URI normalization ( #2370 )
...
* Fix #2119 - Whenever about to send a HTTP request, normalize the URI
* Add test for IDN request in FetchLinkCardService
* Perform IDN normalization on domains before they are stored in the DB
2017-04-25 02:47:31 +02:00
45bee6a000
Show multibyte URI preview card ( #2363 )
2017-04-23 19:08:59 +02:00
1ccf2c8e52
Improve bio compatibility ( #2278 )
...
* Fix #1057 (close #1819 ) - Move HTML-formatted bio from <poco:note /> to <summary type="html" />
* Ensure <poco:note /> is plaintext for remote accounts, also, by stripping out HTML
2017-04-22 03:33:24 +02:00
3d7666f63c
Add Mastodon version to user agent ( #2253 )
2017-04-21 17:26:23 +02:00
a38b05112e
Fix possibility of unrightful webfinger redirect ( #2147 )
...
* Fix possibility of unrightful webfinger redirect
* Add more tests for FollowRemoteAccountService
2017-04-19 17:28:35 +02:00
4591c7dbdb
Language detection refactor ( #2099 )
...
* Extract detect_language to separate class
* Use default locale, not just en
* Add spec to confirm that whatlanguage cant identify empty string
* Allow account locale to override default in language detector
* PostStatusService supplies an account to detect language
2017-04-18 22:20:12 +02:00
1b8613bc7a
Add "Mastodon" to user agent ( #2073 )
...
Remove non-const version string
Freeze option is unnecessary
2017-04-18 16:04:13 +02:00
a9f4feb735
Fix nil query_username ( #2013 )
2017-04-17 19:57:02 +02:00
4863184f88
reduce unneed query when post without attachements. ( #1907 )
...
* reduce unneed query when post without attachements.
This commit reduce following query:
```
MediaAttachment Load (0.9ms) SELECT "media_attachments".* FROM "media_attachments" WHERE "media_attachments"."status
_id" IS NULL AND 1=0 ORDER BY id asc
```
* fixed for more simple changes.
2017-04-17 04:23:13 +02:00
6e801f4030
Fix #1957 - WhatLanguage can return null. Fallback to 'en' ( #1959 )
2017-04-16 23:12:19 +02:00
b9b9edd4c8
Add language detection ( #1772 )
...
* Add language detection via WhatLanguage and (de)serialization of it through Atom
* Fix default language in ProcessFeedService
* Re-add newline before 'react-rails' Gem to fix groupings
Fixes Code Climate issue
2017-04-16 20:32:17 +02:00
5c2010661a
Check @recipient.user at the first ( #1939 )
2017-04-16 18:04:05 +02:00
c2b4bafc33
Fix #1813 - Alleviate extra requests when processing mentions ( #1938 )
...
The <link rel="mentioned" /> tag refers to accounts by href. So we were
matching the DB by the url attribute, and falling back to HTTP look-up.
However, GS and Mastodon use profile URLs as URIs, too, and the match
for that was missing. This could potentially alleviate some extra network
requests
2017-04-16 18:01:48 +02:00
3052fe93ba
Clean up check that account needs a webfinger update ( #1932 )
2017-04-16 16:38:29 +02:00
2aae4c5531
Fixed NoMethodError in UnfollowService ( #1918 )
2017-04-16 14:55:43 +02:00
ba6b4c6e62
Make file attachment on MediaAttachment optional ( #1865 )
...
Create MediaAttachment but without actual file download when domain is blocked with reject_media set to true
Clean up old media files when creating a new domain block with reject_media set to true
Return remote_url in media attachments API if local file is not present
Undo domain block action in admin UI
Ability to enable reject_media from admin UI
2017-04-16 12:51:30 +02:00
efb88aae30
ActiveRecord::Relation does not respond to `#id` ( #1834 )
2017-04-15 13:16:24 +02:00
0d9e4aaaaf
Account search service refactor ( #1791 )
...
* Begin coverage for account search service
* Coverage for hashtag query
* Coverage for calling local vs remote find based on domain presence
* Spec to check that exact matches are not duped
* Coverage of resolve option
* Coverage for account being provided
* Start to refactor account search service
* Isolate query username and domain methods
* Isolate exact_match method
* Extract methods for local and remote results
* Simplify local vs remote and account isoliation
* Extract methods for local and remote results
* Simplify de-dupe of exact match
* Simplify logic to check for non exact remotes
* Cache some methods
* Remove nil from exact_match from results array
* Return exact matches first
* Use find_remote even with no domain
Account.find_local is just an alias for Account.find_remote(user, nil) - so we
can not bother with the conditional here, and call find_remote directly.
2017-04-15 03:17:07 +02:00
626e7d1548
Refresh webfinger ( #1323 )
...
* Refresh local info for remote accounts when webfinger returns new values
It only refreshes account info if one of the URLs or the public-key changes,
in which cases it refreshes the full info, re-downloading the feeds from that
user.
Some special handling should probably be done when the public key changes,
but I have been unable to find any use for it in Mastodon yet.
* Re-fetch remote users we aren't subscribed to.
This might induce performance issues, we might want to only do that for users
we explicitly attempted to subscribe but failed to.
* Refactor changes
* Do not refresh existing remote account details more than once a day
* Avoid re-fetching webfinger info in tests unless otherwise specified
2017-04-15 03:16:05 +02:00
c45c67c2ac
Allow running mastodon on a different domain as the one used for identifying users ( #1267 )
...
* Allow running mastodon on a different domain as the one used for identifying users
* Alter documentation of WEB_DOMAIN to make clear it shouldn't be used unless the admin knows what they are doing
* Compare to web_domain instead of local_domain when dealing with feeds/API
* Correctly identify mentions to local accounts
Mentions URLs point to the person's web profile, i.e., the user page served on WEB_DOMAIN.
2017-04-15 02:15:46 +02:00
8ed4ecb7e4
Silence more scope order warnings ( #1604 )
2017-04-12 15:58:08 +02:00
9a30c564b6
Remove unused AtomBuilderHelper ( #1364 )
...
This was used in the views/atom/user_stream.xml.ruby file, which no longer is
used.
2017-04-11 19:31:22 +02:00
e326eb53dd
Get handle from atom feed's author/email field instead of guessing from URL ( #1344 )
...
The goal of this change is to enhance Mastodon's handling of remote domains
for which the APIs reside on a different host (see issue #1032 ).
Indeed, when a remote user unknown to Mastodon is mentionned, only its profile
URL (e.g. https://social.example.org/users/User ) is known, and Mastodon has to
build a @username@domain handle for it. To do so, Mastodon fetches the user's
atom feed (e.g., https://social.example.org/users/User.atom ) and uses its
content to get the username part of the handle, and the URL's host part to
build the domain (e.g., @User@social.example.org). This handle is then used
for a Webfinger request.
In the case where example.org serves the Webfinger info for @User@example.org
and all feeds and APIs are hosted at social.example.org, Mastodon will still
build @User@social.example.org and fail at resolving the account's details
through Webfinger.
This patch changes this behaviour by using the author's email address from
the atom feed to build the handle. In Mastodon-generated atom feeds, the
email address is always the handle it expects for federation.
2017-04-09 18:43:48 +02:00
697e4da6cb
Fix #1141 , fix #1126 - Avatar/profile info fetching ( #1215 )
...
* Fix #1141 , fix #1126 - Work through UpdateRemoteProfileService for both <feed> and <entry> top-level tags
* Improve code quality, remove line unrelated to fix
2017-04-08 13:26:03 +02:00
0b8bd5a9ce
Merge pull request #1218 from R0ckweb/patch-2
...
Fix #1141 on remote follow
2017-04-08 11:37:13 +02:00
33b00dd70f
#1141 on remote follow
...
The async action is send before persist, account.id not yet generated
Pull queue receive 'nil' so no profile update.
2017-04-08 03:24:35 +02:00
81b7c81200
Fix #801 - Respect webfinger's canonical response of username/domain
2017-04-08 01:07:42 +02:00
1a82d2bde6
Use I18n for media attachment validation errors
...
These are currently user facing errors, but are not localized. This adds the
ability for these messages to be localized.
2017-04-07 14:23:18 -04:00
24c77e57b2
Rewrite Atom generation from stream entries to use Ox instead of Nokogiri ( #1124 )
...
* Rewrite Atom generation from stream entries to use Ox instead of Nokogiri::Builder
StreamEntry is now limited to only statuses, which allows some optimization. Removed
extra queries on AccountsController#show. AtomSerializer instead of AtomBuilderHelper
used in AccountsController#show, StreamEntriesController#show, StreamEntryRenderer
and PubSubHubbub::DistributionWorker
PubSubHubbub::DistributionWorker moves n+1 DomainBlock query to PubSubHubbub::DeliveryWorker
instead.
All Salmon slaps that aren't based on StreamEntry still use AtomBuilderHelper and Nokogiri
* All Salmon slaps now use Ox instead of Nokogiri. No touch from status on account
2017-04-07 05:56:56 +02:00
0db2a0c7c4
Fix wrong pubsub channel on public timelines
2017-04-06 04:03:23 +02:00
fb6459d303
Fix notifications delivered to wrong pubsub channel, optimized RemoveStatusService,
...
slightly optimized FanOutOnWriteService again
2017-04-06 02:26:59 +02:00
cd68e54a7d
Split SalmonWorker into smaller parts, move profile updating into another job
2017-04-05 21:43:10 +02:00
5189ce9cd1
Replace calls to FeedManager#inline_render and #broadcast
2017-04-05 19:45:18 +02:00
8f38353c4d
Only render public payload once in FanOutOnWrite
2017-04-05 14:26:17 +02:00
fa2a1af90a
Spawn FeedInsertWorker to deliver status into personal feed
2017-04-04 19:21:37 +02:00
e60c473917
Reduce number of items in feeds, optimize regeneration worker slightly,
...
make regeneration worker unique, (only schedule/execute once at a time)
2017-04-04 13:58:34 +02:00
8796f7a125
Add check for visibility.nil? even though it can't ever be, to check for race conditions
2017-04-03 22:54:46 +02:00
6ebe31e716
Make default admin UI page reports. Add admin UI for creating a domain block
2017-04-03 18:55:06 +02:00
4db2e2f4eb
Fix issue with feed merge-in code as well
2017-04-02 15:58:25 +02:00
572cf64791
Fix feed regeneration bug
2017-04-02 15:46:31 +02:00
3c6e9ee33c
Fix reworked search
2017-03-31 22:45:56 +02:00
b3cb765a94
Prettier account and stream entry URLs
2017-03-22 19:55:14 +01:00
a015d2e08b
Shorter timeout on FetchAtomService
2017-03-22 17:41:52 +01:00
1b4583ca91
Fix full-text search query quotation, improve tag search performance with an index,
...
add ability to open status by URL from search (fix #53 )
2017-03-22 17:36:34 +01:00
3893f75a51
New API method: /api/v1/search
...
Returns accounts, statuses, hashtags arrays
2017-03-22 02:32:27 +01:00
a19062b726
Federate header images, fix open-uri http->https redirection error
2017-03-18 22:51:20 +01:00
64be072702
Make account search blazing fast and rank followers/followees higher in the results
2017-03-17 20:48:14 +01:00
f1b9644cfd
Add "direct" visibility level in the backend. Web UI is not yet
...
adjusted to allow choosing it, yet
2017-03-15 22:55:45 +01:00
27d4971979
Fix casuality of processing remote mentions such that notifications
...
about them would be processed only after the entire status is processed
2017-03-13 16:34:15 +01:00
9989890e2e
Fix #231 - Muting
2017-03-02 18:49:32 +01:00
4554ccd5d0
Mute button progress so far. WIP, doesn't entirely work correctly.
2017-03-01 22:31:21 -06:00
a741049a77
Fix #104 - Style OAuth authorized applications page
...
Add ability to search accounts by display name
2017-02-27 00:15:00 +01:00
ff8a080d40
Add validation of media attachments, clean up mastodon-own exception classes
2017-02-26 23:23:06 +01:00
128dcdf68a
Merge branch 'fix_462' of https://github.com/rmhasan/mastodon into rmhasan-fix_462
2017-02-26 23:09:18 +01:00
5157e25aab
Add tuning documentation, add <content> tags back to most salmons,
...
make status pagination headers generation more lax about next page
existing
2017-02-25 03:34:37 +01:00
b734ae3029
Skip remote media URLs that don't have a hostname
2017-02-22 19:55:14 +01:00
6d453b00c6
Fix #651 - Do not reinsert original status into all followers feeds
...
upon un-reblogging. Check if the reblog was in the feed in the first
place. It might have been filtered on distribution.
2017-02-22 15:52:47 +01:00
d55cf10b4e
previous commit was creating the status regardless
...
of mix of video and images in status, just wasn't rendering
the show action. I moved the validation before the status creation
2017-02-19 08:28:33 +00:00
008c95b3b9
revisted fix for #462
...
Moved validation to services/post_status_service.rb
2017-02-19 08:28:33 +00:00
94a6dfab3a
Disable PuSH for blocked domains
2017-02-14 04:01:37 +01:00
04b2b771c1
Add IDs to salmon slaps even if they are transient. Add title, too, mostly
...
in case of debugging incoming salmons. Add <thr:in-reply-to /> to favourite
salmons because it seems to be required by GS.
2017-02-13 13:30:33 +01:00
2980de5cc5
Add handler for salmons of undoing favourites
2017-02-12 19:50:18 +01:00
8550d32165
Adding more unit tests. Fixing Salmon slaps XML
2017-02-12 17:30:15 +01:00
f48dc93379
Deduplicate delete salmons (send only one per mentioned-account domain)
2017-02-12 17:30:15 +01:00
f9f8f52fe9
Stop trying to shoehorn all Salmon updates into the poor database-connected
...
StreamEntry model. Simply render Salmon slaps as they are needed
2017-02-12 01:19:14 +01:00
12ed6f5712
Resolve issue with rendering authorize/reject Salmon slaps
2017-02-11 19:42:05 +01:00
ce193afa4f
Mentions in private statuses allow mentioned people to see them
2017-02-11 15:10:22 +01:00
1e66536797
After FollowService, re-fetch remote account asynchronously, do nothing
...
if account lock info was up to date, otherwise re-do the FollowService
with now updated information
2017-02-11 14:25:01 +01:00
1dbe19291d
Fix processing of incoming authorizations/rejections
2017-02-11 13:55:07 +01:00
79b86d7ffa
Don't PuSH-resubscribe if already subscribed
2017-02-11 13:48:28 +01:00
59c8c2b28a
Make follow requests federate
2017-02-11 02:58:00 +01:00
81be690f95
Fix #614 - extra reply-boolean on statuses to account for cases when replied-to
...
status is not in the system at time of distribution; fix #607 - reset privacy
settings to defaults when cancelling replies
2017-02-09 20:25:39 +01:00
eb9934c88c
Add streaming API channels for local-only statuses
2017-02-06 23:46:14 +01:00
43be729e6b
Don't allow people to follow people they blocked without unblocking first
2017-02-05 21:04:22 +01:00
d384845469
Fix #61 - Add list of blocked users to the UI; clean up failed push notifications API
...
Try to fix Travis CI setup
2017-02-05 19:18:11 +01:00
efa4065029
Preheat status cache
2017-02-05 17:24:18 +01:00
c7b7eb8067
Fix #598 - arrow keys to navigate media; fix #481 - non-exact matches no longer
...
overshadow requirement for remote-lookup
2017-02-05 03:01:23 +01:00
00261b46ec
Move rendering of JSON payloads for public/hashtag timelines to
...
FanOutOnWriteService. The only recipient-specific part on them
is reblogged/favourited. But since only newly created statuses
appear on them, it is safe to assume that both attributes would
be false
2017-02-02 00:39:17 +01:00
727d236fcc
Cleaning up format of broadcast real-time messages, removing
...
redis-backed "mentions" timeline as redundant (given notifications)
2017-02-02 00:03:31 +01:00
edcfbee9f5
Fix #529 - Make hashtag timelines show conversations, fix hashtag loading in the UI
2017-01-31 22:35:38 +01:00
d5a3d0aca2
Fix tests
2017-01-29 12:25:10 +01:00
9327d05bf7
API for apps to register for push notifications
2017-01-29 01:30:32 +01:00
27ad4ce9e8
Do not run FetchLinkCardService on local URLs, increase file size limit to 8MB,
...
fix ProcessFeedService pushing status into distribution if called a second time
while the first is still running (i.e. when a PuSH comes after a Salmon slap),
fix not running escape on spoiler text before emojify
2017-01-27 16:57:23 +01:00
4d011ee829
Use <summary> to encode content warnings instead
2017-01-25 16:53:30 +01:00
e17b31bca6
Fix #522 - prevent blocked users from reblogging
2017-01-25 01:48:46 +01:00
959e064186
Instead of using spoiler boolean and spoiler_text, simply check for non-blank spoiler_text
...
Federate spoiler_text using warning attribute on <content /> instead of a <category term="spoiler" />
Clean up schema file from accidental development migrations
2017-01-25 01:29:16 +01:00
c7778752e3
Merge branch 'master' into master
2017-01-24 21:56:06 +01:00
ea8b548ee9
Make blocks create entries and unfollows instantly, but do the clean up
...
in the background instead. Should fix delay where blocked person
can interact with blocker for a short time before background job
gets processed
2017-01-24 21:40:41 +01:00
e25fc71c2c
Implement a click-to-view spoiler system
2017-01-23 21:07:40 -05:00
9650e27b7b
Domains with reject_media? set to true won't download avatars either
2017-01-23 21:55:29 +01:00
3710d18889
Optional domain block attribute that prevents media attachments from being downloaded
2017-01-23 21:36:08 +01:00
98660a76d9
Move merging/unmerging of timelines into background. Move blocking into
...
background as well since it's a computationally expensive
2017-01-23 21:29:34 +01:00
e55bad5740
Remove unneeded block check
2017-01-23 17:40:23 +01:00
77a76d5171
Domain blocks now have varying severity - auto-suspend vs auto-silence
2017-01-23 17:38:38 +01:00
55d6cd41e6
Fix a couple unhandled exceptions
2017-01-23 13:56:57 +01:00
26cfebf434
Call uniq on the string version of mb_chars tags
2017-01-21 21:02:42 +11:00
d8d22cfa6f
Instead of refusing to create accounts, domain blocks auto-suspend new accounts from that domain
2017-01-20 20:14:02 +01:00
9d09b2c6b1
Fix preview cards layout, do preview card crawling for remote statuses
2017-01-20 18:31:49 +01:00
f748a91ec7
Fix #463 - Fetch and display previews of URLs using OpenGraph tags
2017-01-20 01:00:14 +01:00
5d88ef90c9
Fix tests, add applications to eager loading/cache for statuses, fix
...
application website validation, don't link to app website if website isn't set,
also comment out animated boost icon from #464 until it's consistent with non-animated version
2017-01-15 14:01:33 +01:00
8e0c1914fb
Add tracking of OAuth app that posted a status, extend OAuth apps to have optional website field, add application details to API, show application name and website on detailed status views. Resolves #11
2017-01-15 08:58:50 +11:00
4b384d6914
Fix too late return
2017-01-14 02:22:16 +01:00
7e7c2bbb0f
Migrate from ledermann/rails-settings to rails-settings-cached which allows global settings
...
with YAML-defined defaults. Add admin page for editing global settings. Add "site_description"
setting that would show as a paragraph on the frontpage
2017-01-12 20:46:24 +01:00
992c8d2c41
Add ruby version to Gemfile, move devDependencies in package.json to dependencies,
...
fix bug in process feed service
2017-01-11 15:39:31 +01:00
126aba0e13
Fix #147 - Unreblogging will leave original status in feeds
2017-01-07 15:44:22 +01:00
66c5363bae
Fix undesired delivering of private toot to remote accounts that follow author
2017-01-05 03:17:23 +01:00
b57e126d47
Unblocks also federate
2017-01-02 14:19:02 +01:00
043d9114bf
Federate blocks with the http://mastodon.social/schema/1.0 verb namespace
2017-01-02 12:17:51 +01:00
6a20c13009
Add API for retrieving favourites
2016-12-29 20:33:26 +01:00
34febf75be
Fix wrong person being notified after nested reblog call, fix favourites leaking private toots in Atom feeds
2016-12-28 13:21:12 +01:00
cef68b9b1c
Follow requests send e-mail notifications, but are excluded from notifications API
...
Better initial state for unlisted/nsfw toggles
2016-12-26 21:52:03 +01:00
1ed3bb3a02
Don't show statuses to blocked users
2016-12-26 19:13:56 +01:00
77cd58545d
Re-enable Webfinger for locked accounts but don't handle "follow" events
...
coming in via Salmon.
Currently no way to prevent remote follows, but they will only receive public
and unlisted posts
2016-12-22 23:17:57 +01:00
337c3d0ed8
Private posts mentioning non-followers should not notify them, neither locally nor via Salmon
2016-12-22 23:14:24 +01:00
238233440f
Follow call on locked account creates follow request instead
...
Reflect "requested" relationship in API and UI
Reflect inability of private posts to be reblogged in the UI
Disable Webfinger for locked accounts
2016-12-22 23:03:57 +01:00
09a477c782
Add "locked" flag to accounts, prevent blocked users from following, force-unfollow blocked users
2016-12-22 21:34:19 +01:00
d417da7d3a
Private visibility on statuses prevents non-followers from seeing those
...
Filters out hidden stream entries from Atom feed
Blocks now generate hidden stream entries, can be used to federate blocks
Private statuses cannot be reblogged (generates generic 422 error for now)
POST /api/v1/statuses now takes visibility=(public|unlisted|private) param instead of unlisted boolean
Statuses JSON now contains visibility=(public|unlisted|private) field
2016-12-21 20:04:13 +01:00
9d4f96f440
Removing external hub completely, fix #333 fixing digit-only hashtags,
...
removing web app capability from non-webapp pages
2016-12-18 12:24:37 +01:00
b7c2c5d81d
Restoring old async behaviour of thread resolving as it proved to be more robust
2016-12-12 21:12:19 +01:00
e9e11b0ff5
Sensitive content federates using the "nsfw" hashtag
2016-12-11 22:49:25 +01:00
fb36684678
Thread resolving no longer needs to be separate from ProcessFeedService,
...
since that is only ever called in the background
2016-12-11 22:23:11 +01:00
51e60135ed
Improve suspend account service
2016-12-06 18:32:36 +01:00
88218c83d5
Add suspend account functionality to admin UI
2016-12-06 18:22:59 +01:00
7752662f97
Add filters for suspended accounts
2016-12-06 18:03:30 +01:00
6837480719
Adding suspend account service
2016-12-06 17:41:42 +01:00
ca0757a6cf
Add account suspension
2016-12-05 22:59:30 +01:00
42b065d3d7
Automatically block outgoing notifications from silenced accounts to users
...
who don't follow them
2016-12-04 16:51:49 +01:00
23a4f93345
Fix #323 - self-replies to appear in public timelines again
2016-12-02 14:33:20 +01:00
211049ae59
Fix #329 - avatar errors no longer prevent remote accounts from being saved
...
(without avatar). Also improved search position of exact matches
2016-12-02 14:14:49 +01:00
8d4ef0b6c3
Per-status control for unlisted mode, also federation for unlisted mode
...
Fix #233 , fix #268
2016-11-30 21:34:59 +01:00
c0bb1ed7c5
Fix trying to PuSH-publish updates of remote removals
2016-11-29 17:41:47 +01:00
66e01be769
Fix delete Salmons
2016-11-28 19:44:27 +01:00
0cc5410e03
Adding backtracing to Salmon/Processing workers
2016-11-28 19:11:36 +01:00
95321e961b
Fix Pubsubhubbub::UnsubscribeService
2016-11-28 18:14:49 +01:00
b5ad0eb4ea
Adding embedded PuSH server
2016-11-28 13:36:47 +01:00
31108d4659
Public and hashtag timelines now exclude reblogs and replies
...
Fix #289 - don't download avatar unless the URL is http/https
Fix #293 - reblog/reblogged is now boost/boosted
2016-11-26 15:45:35 +01:00
1f62ffcc7a
Fix #288 - Strip first @ from search query, don't search accounts if it begins with #
2016-11-26 15:32:29 +01:00
1997e331ce
Fix #278 - Use mb_chars.downcase on hashtags
2016-11-26 15:24:14 +01:00
23162b2893
Update hub URL and re-subscribe if hub URL changes
2016-11-26 15:18:21 +01:00
ea0846645a
Fix #65 - Options to block notifications from people you don't follow/who don't follow you
2016-11-25 13:13:16 +01:00
f613f2b84a
Only distribute statuses to followers who signed in in the last 2 weeks, add rake task for clearing feeds of inactive users
2016-11-24 18:17:58 +01:00
f6d196255c
Fix unfollows not clearing reblogs, fix blocks not clearing reblogs and notifications,
...
skip ActionCable for follow/unfollow/block events, instead clear UI from
blocked account's posts instantly if block request succeeds. Add forgotten
i18n for sensitive content
2016-11-23 22:57:57 +01:00
65d6191147
Adding sensitive marker to statuses in API
2016-11-23 10:46:48 +01:00
30010a6dbd
Moving some counter queries out of subqueries in the API
2016-11-22 22:59:54 +01:00
f07b0dc82f
Remove unneeded indices, improve error handling in background workers, don't needlessly reload reblogged status, send Devise e-mails asynchronously
2016-11-22 17:32:51 +01:00
0943e98288
Adding option to specify asset server, filter followers query by local accounts
...
during Fan Out On Write to load less stuff into memory
2016-11-21 22:04:10 +01:00
dc8b46ecbc
Use old rules for mention notifications as for mentions timeline
2016-11-21 10:37:34 +01:00
3fc7820d6e
Call NotifyService about remote reblogs
2016-11-21 09:56:01 +01:00
38025dfea3
Adding unified streamable notifications
2016-11-20 19:39:58 +01:00
b373fb0ff6
Catch validation errors in ProcessFeedService so that one failing entry wouldn't stop others from going through
2016-11-18 23:19:38 +01:00
d2029a8845
Don't create attachments if remote file cannot be fetched
2016-11-18 23:16:34 +01:00
e71b152d89
Fix rubocop issues, introduce usage of frozen literal to improve performance
2016-11-15 16:56:29 +01:00
6f0d312dc3
Force utf-8 encoding when processing XML
2016-11-13 19:12:40 +01:00
6206f75837
Add limit to search results
2016-11-12 14:49:28 +01:00
cbfa28b9cc
Use full-text search for autosuggestions
2016-11-12 14:36:10 +01:00
aed424aef0
Fix live status removal from public/hashtag channels
2016-11-10 00:47:47 +01:00
0b03bbad67
Discard misattributed remote statuses, improve timelines filter
2016-11-10 00:15:49 +01:00
a6ae45e8d7
Status removal is broadcast to public/hashtag timelines too
2016-11-09 19:16:27 +01:00
c0ee14756f
Adding more logging
2016-11-08 19:37:08 +01:00
ac79369f2b
Fix for thread resolve service and process feed service url method
2016-11-08 19:09:22 +01:00
9da30e31c8
Fix region setting for AWS gem
2016-11-08 18:55:46 +01:00
f1d2c46ded
Improve feed regeneration
2016-11-08 02:08:32 +01:00
663c0edd8d
Fix typo
2016-11-08 01:48:17 +01:00
434c3fb2f7
ProcessFeedService refactor
2016-11-08 01:44:51 +01:00
8f0869876b
Improved configuration from ENV, cleaned up timeline filter methods
...
to be more readable, add extra logging to process feed service
2016-11-07 23:20:52 +01:00
5ad6611101
Add test for FanOutOnWriteService
2016-11-06 15:56:34 +01:00
f0956d434c
Improve @mention regex
2016-11-05 22:09:51 +01:00
cb22dce970
Adding hashtags
2016-11-05 17:13:14 +01:00
4c3885b952
Allow @username@domain/@username in follow form, prevent duplicate accounts
...
created via remote look-up when domains differ but point to the same resource
2016-11-03 16:57:44 +01:00
72565e9e61
Fix subtle bugs, new icon button
2016-11-02 22:29:19 +01:00
1eac265f35
Adding public timeline silencing
2016-10-27 19:33:04 +02:00
d63f0295b9
Fix public channel
2016-10-23 11:56:04 +02:00
cc10f56f66
Fix method return when rescuing
2016-10-20 18:36:12 +02:00
bcdb0dc310
Fix RemoveStatusService trying to send delete salmons on behalf of remote statuses
2016-10-16 19:14:23 +02:00
4762bb6b7a
Fix duplication of media attachments when a remote status reblogs a local one
2016-10-14 20:15:37 +02:00
7beab6b00c
Fix remove status service sending salmons
2016-10-14 20:09:33 +02:00
405f7f0541
No-op for Salmons without body, fail fast if Webfinger does not contain
...
all required resource links (profile page, salmon, atom feed, magic key)
2016-10-13 13:41:06 +02:00
dd99153ce6
Treat dfrn:owner like xmlns:author for Friendica compatibility
2016-10-12 22:55:00 +02:00
a1d34be18b
Improve Friendica support (but still not there yet)
2016-10-12 21:07:00 +02:00
34bfc0f0dc
Fix up a few exceptions
2016-10-12 19:25:46 +02:00
1af00c8193
Fixing namespaces issue
2016-10-10 19:16:23 +02:00
61d7c88408
Fix namespace parsing in Atom feeds
2016-10-10 18:16:07 +02:00
80217fd58b
Use Account#find_remote method when possible
2016-10-10 17:30:49 +02:00
3d229e3937
Don't return unsaved status from ProcessFeedService
2016-10-10 16:49:05 +02:00
33668b91f8
Adding test for ProcessFeedService
2016-10-10 16:03:38 +02:00
5da603fb6f
Improve process feed service
2016-10-10 15:27:39 +02:00
d2c7d9fc4e
PuSH unsubscribe needs correct callback URL
2016-10-10 03:40:08 +02:00
7cb55af441
Fix default assumed object type (note->activity), make stream entry threaded? check aware of orphaned replies
2016-10-10 02:55:30 +02:00
9bf5a73968
Adding domain blocks
2016-10-09 14:48:59 +02:00
c3f5dfeabb
Adding public timeline
2016-10-07 16:00:11 +02:00
62498dcefd
Fix #83 - if user cannot be found (or is self) throw error, don't return empty 200
...
This prevents the undefined profile from being opened in the first place on such an error
2016-10-06 21:33:33 +02:00
b23c4b488c
Better comparison of "local" domain
2016-10-06 16:36:16 +02:00
6e8165696c
Update OStatus2 to handle malformed Salmon without raising unexpected exceptions
2016-10-06 14:47:38 +02:00
96cc77ce55
Catch Paperclip errors on /api/v1/media, return early from update profile service if XML given is nil
2016-10-06 14:40:15 +02:00
3319473b2c
Move PubSubHubbub pinging to a background worker
...
It can take as much as 0.5s if not longer to complete
2016-10-05 13:50:21 +02:00
2febc6ed65
Fix typo
2016-10-05 13:40:14 +02:00
fe77921e47
Catching more exceptions that slipped through, removing AR logging from
...
production as it's very verbose and not very useful
2016-10-05 13:26:44 +02:00
70e9dd0b5b
Blocking will prevent e-mail notifications from blocked user, blocks in UI
2016-10-03 18:49:52 +02:00
7b9a4af311
API for blocking and unblocking
2016-10-03 18:17:06 +02:00
9d59d7b463
Adding a block model and filter mentions from blocked users ( fix #60 )
2016-10-03 17:12:13 +02:00
d74da1a89a
Small fixes
2016-10-02 23:46:25 +02:00
be86d4e0a3
Preparing feeds for better filtering
2016-10-02 15:28:47 +02:00
927333f4f8
Improve code style
2016-09-29 21:28:21 +02:00
e4aebad35a
Fix handling of multiple Link headers (that should not be a thing though)
2016-09-27 23:49:12 +02:00
7e14eefc81
Replace logo, fix #57 - delete/unreblog/unfavourite API, fix #45 - app
...
registration API
2016-09-26 23:56:53 +02:00
210362e665
Improve redirect handling in FetchAtomService
2016-09-26 17:04:05 +02:00
c6b0311b86
Fix #54 - Fetch remote accounts by URL from mentions
...
Fetching atom extracted from FetchRemoteAccountService and FetchRemoteStatusService
into FetchAtomService. Mentions of the constant "http://activityschema.org/collection/public "
skipped as it's not a real URL/user.
2016-09-26 16:44:40 +02:00
b1a670af8d
Handle remote account mentions a little better by trying a URL lookup in the db
2016-09-22 21:10:36 +02:00
4a670780f0
Fix #51 - prevent duplicate attachments for remote statuses
2016-09-22 20:42:20 +02:00
4bec613897
Fix #24 - Thread resolving for remote statuses
...
This is a big one, so let me enumerate:
Accounts as well as stream entry pages now contain Link headers that
reference the Atom feed and Webfinger URL for the former and Atom entry
for the latter. So you only need to HEAD those resources to get that
information, no need to download and parse HTML <link>s.
ProcessFeedService will now queue ThreadResolveWorker for each remote
status that it cannot find otherwise. Furthermore, entries are now
processed in reverse order (from bottom to top) in case a newer entry
references a chronologically previous one.
ThreadResolveWorker uses FetchRemoteStatusService to obtain a status
and attach the child status it was queued for to it.
FetchRemoteStatusService looks up the URL, first with a HEAD, tests
if it's an Atom feed, in which case it processes it directly. Next
for Link headers to the Atom feed, in which case that is fetched
and processed. Lastly if it's HTML, it is checked for <link>s to the Atom
feed, and if such is found, that is fetched and processed. The account for
the status is derived from author/name attribute in the XML and the hostname
in the URL (domain). FollowRemoteAccountService and ProcessFeedService
are used.
This means that potentially threads are resolved recursively until a dead-end
is encountered, however it is performed asynchronously over background jobs,
so it should be ok.
2016-09-21 01:50:31 +02:00
608a2bfffc
Upgrade to PubSubHubbub 0.4 (removing verify_token)
2016-09-20 02:43:20 +02:00
059ebbf48d
Separate PuSH subscriptions from following, add mastodon:push:refresh task,
...
respect hub.lease_seconds (fix #46 )
2016-09-20 00:43:36 +02:00
9863196f7b
Small rubocop offences removed
2016-09-18 13:42:24 +02:00
adffc7a495
Fix #43
2016-09-18 12:28:49 +02:00
183a23943b
Fix how other services used old FollowRemoteAccountService
2016-09-17 17:07:45 +02:00
0e9c1a297a
Improved error handling for FollowRemoteService
2016-09-17 17:03:36 +02:00
8c0b19012b
Fix #41 , debug #42
2016-09-17 16:36:10 +02:00
d6a64f45fd
Adding a notification stack for error messages
2016-09-12 19:20:55 +02:00
05b0c985b4
Send "delete" Salmons to remote mentioned accounts on status removal
...
Fixes #27
2016-09-12 18:33:34 +02:00
ce29624c6d
Fixing image upload limits, allowing webm, merge/unmerge events trigger
...
timeline reload in UI, other small fixes
2016-09-12 18:22:43 +02:00
0077fc26df
Merge and unmerge timelines on follow/unfollow, solves #21 , #22
2016-09-10 18:36:48 +02:00
76c40cbfb1
Disallow self-follow
2016-09-10 10:01:08 +02:00
3cc47beb6e
Refactored generation of unique tags, URIs and object URLs into own classes,
...
as well as formatting of content
2016-09-09 20:04:34 +02:00
509c18eb13
Fix local follows, 404 in logs
2016-09-08 02:40:51 +02:00
499beb4484
UI for uploading media attachments (and cancelling them)
...
Mostly resolves #8 , though attachments are still not displayed in public view
2016-09-07 18:21:57 +02:00
1efa8e48d1
Fix enclosures not being parsed for reblogged statuses
2016-09-06 12:30:15 +02:00
eec0dc46a6
PostStatusService can attach media to status, ProcessFeedService likewise
2016-09-05 18:39:53 +02:00
926eea89b5
RemoveStatusService fleshed out, still doesn't send Salmon slaps though
2016-09-05 01:59:46 +02:00
35dfc0fbcb
Fixed more case-sensitivity issues
2016-09-04 21:15:52 +02:00
29996a7e8b
Fix wrongful mentions breaking status update
2016-09-04 21:07:29 +02:00
54ea7f5dfe
Case-insensitive search by usernames
2016-09-04 21:06:04 +02:00
a289c1d52f
Handle delete Salmons, todo: clean up timelines
2016-09-04 14:44:16 +02:00
49520d6e62
Adding React.js, Redux, revamping dashboard
2016-08-24 17:56:44 +02:00
6426819b6f
Fix tests
2016-08-18 17:22:44 +02:00
6deb9f966e
Live timelines using ActionCable
2016-08-18 15:49:51 +02:00
85b00d19b8
Moving Salmon notifications to background processing, fixing mini-profiler
...
behaviour with Turbolinks enabled, optimizing Rabl for production
2016-03-26 13:42:10 +01:00
da4b675aca
Fix favourite handling in ProcessInteractionService
2016-03-26 01:34:12 +01:00
e24bfbde1a
Fixing FanOutOnWriteService, fixing Sidekiq not having enough DB connections
...
in the pool, adding a throttle of 60rpm per IP, adding mini profiler, adding
admin status to users
2016-03-25 14:12:24 +01:00
8eeec389c1
Add link to github project to footer, move FanOutOnWriteService calls to
...
DistributionWorker. That isn't the heaviest service, yet, but gotta start
somewhere
2016-03-25 03:22:26 +01:00
a08e724476
Fix subscriptions:clear task, refactor feeds, refactor streamable activites
...
and atom feed generation to some extent, as well as the way mentions are
stored
2016-03-25 02:13:30 +01:00
97d5aba1ec
Do not try to send notification e-mails for reblogs if the reblog is not of a
...
local account
2016-03-24 13:25:33 +01:00
12559b01ea
Add pagination by max_id instead of offset/limit
2016-03-22 21:38:47 +01:00
f14f462eaf
Adding Turbolinks, adding status posting form on homepage
2016-03-21 18:26:47 +01:00
9d55529318
Fix text color in dashboard inputs, sanitize remote status content in UI,
...
simplify FanOutOnWriteService, add /api/accounts/lookup method
2016-03-21 17:02:16 +01:00
46cbb9c551
Increase note truncation length on account grids, improve FanOutOnWrite a bit,
...
fix tests (the recorded Salmon fixture expects LOCAL_DOMAIN to be something
specific unfortunately)
2016-03-21 08:44:30 +01:00
b640f35621
Writing out more tests, fixed some bugs
2016-03-20 13:03:06 +01:00
7e53efae31
Fix for incoming favourites
2016-03-19 22:46:58 +01:00
2b116131d7
Adding e-mail notifications about mentions, follows, favourites and reblogs. Fixing another mention recording bug
2016-03-19 19:20:07 +01:00
d4892ace62
Adding more test stubs
2016-03-19 12:13:47 +01:00
66a2107527
Turns out that replies don't have to have the type comment. Changed handling
...
of those to depend on presence of <thr:in-reply-to /> instead
2016-03-19 11:59:23 +01:00
f97fc9744f
Use FanOutOnWriteService AFTER processing mentions
2016-03-19 00:41:29 +01:00
071f64d317
Fix #13 , Atom feeds now contain formatted post content
2016-03-19 00:16:04 +01:00
580b91c387
Fix more subtle bugs with first_or_create
2016-03-19 00:02:39 +01:00
48aeacd5f9
Fixed ANOTHER first_or_create bug. Seriously who came up with that API smh
2016-03-18 23:47:02 +01:00
9a7485d034
Fix typo on /api/accounts/:id/statuses, fix potential case-sensitivity issue
...
when registering incoming status mentions, add Travis CI file
2016-03-18 23:23:19 +01:00
af7ae348d7
Include AtomBuilderHelper (which declared url_for_target) to all services
2016-03-16 22:44:04 +01:00
d022975444
Fixing small bug with FollowRemoteAccountService usage
2016-03-16 21:20:50 +01:00
086d487145
Fix unfollows
2016-03-16 21:14:39 +01:00
75b3339a99
Respect "delete" verb on remote feeds
2016-03-16 10:46:15 +01:00
1aa477ac2f
Customized more doorkeeper views, only logged in users can create oauth apps
2016-03-12 19:46:06 +01:00
447cfef62d
Improving feed queries, switching API to doorkeeper authentication
2016-03-11 16:47:36 +01:00
6c4c84b161
Distrubute statuses as a fan-out-on-write system, with optional precomputing
2016-03-08 20:20:45 +01:00
ab6696e855
Adding doorkeeper, adding a REST API
...
POST /api/statuses Params: status (text contents), in_reply_to_id (optional)
GET /api/statuses/:id
POST /api/statuses/:id/reblog
GET /api/accounts/:id
GET /api/accounts/:id/following
GET /api/accounts/:id/followers
POST /api/accounts/:id/follow
POST /api/accounts/:id/unfollow
POST /api/follows Params: uri (e.g. user@domain)
OAuth authentication is currently disabled, but the API can be used with HTTP Auth.
2016-03-07 12:42:33 +01:00
c605b828b5
Adding routes to follow, unfollow, favourite and reblog (locally known models)
2016-03-06 12:51:55 +01:00
23d08c6749
Changing the use of config constants to the Rails configuration object
2016-02-29 20:06:39 +01:00
0e8f59c16f
Refactoring Grape API methods into normal controllers & other things
2016-02-29 19:42:08 +01:00
11ff92c9d7
Adding a test for ReblogService, fixing mentions for remote statuses
2016-02-28 21:22:56 +01:00
47d50b0e39
A lot of fixes from a live test
2016-02-28 15:46:29 +01:00
9ec03ab5f5
Ping hubs when following somebody, too
2016-02-28 14:34:25 +01:00
8fada4fae2
When posting a status or reblogging one, ping hubs about the feed update
2016-02-28 14:33:13 +01:00
ad5ae3f60e
Update profile information and download avatar of remote accounts
2016-02-28 14:26:26 +01:00
f16b31f077
Adding a bunch of tests
2016-02-26 15:28:08 +01:00
44c5958203
Fixed small bugs and code style offences
2016-02-25 00:22:46 +01:00
71fe24096c
Adding a Mention model, test stubs
2016-02-25 00:17:01 +01:00
42eeecba3f
Service to reblog statuses
2016-02-24 18:50:16 +01:00
c967802c43
Notify remote users about mentions
2016-02-24 18:44:03 +01:00
79609d6270
Add service for posting statuses (normal and replies), mention regex to
...
fetch webfinger information of mentioned accounts
2016-02-24 18:25:04 +01:00
8da8387afe
Add shared statuses to the database
2016-02-24 17:23:59 +01:00
fa7868675d
Send Salmon interactions
2016-02-24 12:57:29 +01:00
10eb47a33e
Do not PuSH-subscribe to remote accounts when creating them for salmon
2016-02-24 03:05:40 +01:00
784b9cca6a
Forgotten argument fix
2016-02-24 02:15:58 +01:00
9411e8c35a
Feed processing except fetching remote statuses
2016-02-24 01:28:53 +01:00
79baf2fd99
Process favourites, reblogs and replies from Salmon
2016-02-24 00:57:47 +01:00
ee73d35eea
Incoming Salmon requests can be turned into follows and unfollows
2016-02-23 22:17:07 +01:00
fa33750105
Adding reblogs, favourites, improving atom generation
2016-02-23 19:17:37 +01:00
3b0bc18db9
Improved Atom rendering templates, added README
2016-02-23 13:08:01 +01:00
2bc48e9064
Individual atom entries
2016-02-22 19:11:07 +01:00
Eugen Rochko