snac.8 15 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516
  1. .Dd $Mdocdate$
  2. .Dt SNAC 8
  3. .Os
  4. .Sh NAME
  5. .Nm snac
  6. .Nd snac administration
  7. .Sh DESCRIPTION
  8. The
  9. .Nm
  10. daemon processes messages from other servers in the Fediverse
  11. using the ActivityPub protocol.
  12. .Pp
  13. This is the admin manual. For user operation, see
  14. .Xr snac 1 .
  15. For file and data formats, see
  16. .Xr snac 5 .
  17. .Ss Special cares about your snac you must know beforehand
  18. .Nm
  19. makes heavy use of hard links and link reference counts for its work, so
  20. don't even think of using it on a filesystem that doesn't support this
  21. feature. Most UNIX-like operating systems (Linux, the BSDs, the old DEC
  22. Ultrix machine in your grandfather basement, probably MacOS) support hard
  23. links on their native filesystems. Don't do fancy things like moving the
  24. subdirectories to different filesystems. Also, if you move your
  25. .Nm
  26. installation to another server, do it with a tool that respect hard
  27. link counts. Remember:
  28. .Nm
  29. is a very UNIXy program that loves hard links.
  30. .Ss Building and Installation
  31. A C compiler must be installed in the system, as well as the development
  32. headers and libraries for OpenSSL (or compatible) and curl. To build
  33. .Nm ,
  34. run
  35. .Bd -literal -offset indent
  36. make
  37. .Ed
  38. .Pp
  39. And, after that, run as root
  40. .Bd -literal -offset indent
  41. make install
  42. .Ed
  43. .Ss Data storage Initialization
  44. Once
  45. .Nm
  46. is properly installed on the system, designate a directory where
  47. the server and user data are to be stored. This directory
  48. must not exist yet.
  49. .Nm
  50. must always be run as a regular user; you can create one for
  51. it or use your own. To initialize the data storage, execute
  52. .Bd -literal -offset indent
  53. snac init $HOME/snac-data
  54. .Ed
  55. .Pp
  56. A small set of questions will be asked regarding the installation,
  57. specially the host name it will run under, the local network address
  58. and port
  59. .Nm
  60. will listen to, the optional path prefix and possibly other things.
  61. .Pp
  62. You can launch the
  63. .Nm
  64. process by running
  65. .Bd -literal -offset indent
  66. snac httpd $HOME/snac-data
  67. .Ed
  68. .Pp
  69. Use a web browser to connect to the specified address and port. You
  70. should see a greeting page.
  71. .Pp
  72. Log messages are sent to the standard error stream. By default, only
  73. relevant information is written there. You can increase the debugging
  74. level by editing the 'dbglevel' field in the
  75. .Pa server.json
  76. file or by setting a numeric value between 0 and 3 to the DEBUG
  77. environment variable, see below.
  78. .Pp
  79. If you operate a Linux systemd-enabled system, OpenBSD or FreeBSD, there are
  80. startup scripts and configuration data in the
  81. .Pa examples
  82. directory.
  83. For other operating systems, please read the appropriate documentation
  84. on how to install a daemon as a non-root service.
  85. .Ss Upgrading to a new version
  86. Sometimes, the data storage disk layout changes between versions. If there
  87. is such a change,
  88. .Nm
  89. will refuse to run and require an upgrade. Do this by running
  90. .Bd -literal -offset indent
  91. snac upgrade $HOME/snac-data
  92. .Ed
  93. .Pp
  94. Take special care to execute this upgrade operation without any
  95. .Nm
  96. processes serving on the same folder. You can break everything. I know
  97. this because Tyler knows this.
  98. .Pp
  99. .Ss Server Setup
  100. .Pp
  101. An http server with TLS and proxying support must already be
  102. installed and configured.
  103. .Nm
  104. runs as a daemon and listens on a TCP/IP socket, preferrably
  105. on a local interface. It can serve the full domain or only
  106. a directory. The http server must be configured to route to the
  107. .Nm
  108. socket all related traffic and also the webfinger standard
  109. address. The Host header must be propagated.
  110. See the examples below.
  111. .Ss Adding Users
  112. .Pp
  113. Users must be created from the command line.
  114. You can do it by running
  115. .Bd -literal -offset indent
  116. snac adduser $HOME/snac-data
  117. .Ed
  118. .Pp
  119. All needed data will be prompted for. There is no artificial limit
  120. on the number of users that can be created.
  121. .Ss Customization
  122. The
  123. .Pa server.json
  124. configuration file allows some behaviour tuning:
  125. .Bl -tag -width tenletters
  126. .It Ic host
  127. The host name.
  128. .It Ic prefix
  129. The URL path prefix.
  130. .It Ic address
  131. The listen network address.
  132. .It Ic port
  133. The listen network port.
  134. .It Ic dbglevel
  135. The debug level. An integer value, being 0 the less verbose (the default).
  136. .It Ic layout
  137. The disk storage layout version. Never touch this.
  138. .It Ic queue_retry_max
  139. Messages sent out are stored in a queue. If the posting of a messages fails,
  140. it's re-enqueued for later. This integer configures the maximum count of
  141. times the sending will be retried.
  142. .It Ic queue_retry_minutes
  143. The number of minutes to wait before the failed posting of a message is
  144. retried. This is not linear, but multipled by the number of retries
  145. already done.
  146. .It Ic max_timeline_entries
  147. This is the maximum timeline entries shown in the web interface.
  148. .It Ic timeline_purge_days
  149. Entries in the timeline older that this number of days are purged.
  150. If you don't want any timeline purging and enjoy your data drives
  151. fill up with old crap and finally burst in flames, you can disable
  152. purging by setting this to 0.
  153. .It Ic local_purge_days
  154. Same as before, but for the user-generated entries in the local timeline.
  155. .It Ic cssurls
  156. This is a list of URLs to CSS files that will be inserted, in this order,
  157. in the HTML before the user CSS. Use these files to configure the global
  158. site layout.
  159. .It Ic disable_cache
  160. If set to true, timeline caching is not done. This is only useful for
  161. debugging purposes; don't enable it unless you know what do you want, as
  162. it makes everything slower.
  163. .It Ic disable_openbsd_security
  164. If running under OpenBSD,
  165. .Nm
  166. makes use of the enhanced security functions
  167. .Xr unveil 2
  168. and
  169. .Xr pledge 2 .
  170. Setting this to true disables their usage. These functions limit severely
  171. what an intruder can do in case of a security vulnerability, so only enable
  172. this option if something is very broken.
  173. .It Ic num_threads
  174. By setting this value, you can specify the exact number of threads
  175. .Nm
  176. will use when processing connections. Values lesser than 4 will be ignored.
  177. .It Ic disable_email_notifications
  178. By setting this to true, no email notification will be sent for any user.
  179. .It Ic disable_inbox_collection
  180. By setting this to true, no inbox collection is done. Inbox collection helps
  181. being discovered from remote instances, but also increases network traffic.
  182. .It Ic http_headers
  183. If you need to add more HTTP response headers for whatever reason, you can
  184. fill this object with the required header/value pairs. For example, for enhanced
  185. XSS security, you can set the "Content-Security-Policy" header to "script-src ;"
  186. to be totally sure that no JavaScript is executed.
  187. .It Ic show_instance_timeline
  188. If this is set to true, the instance base URL will show a timeline with the latest
  189. user posts instead of the default greeting static page. If other information
  190. fields are set (see below), they are also shown.
  191. .It Ic admin_email
  192. The email address of the instance administrator (optional).
  193. .It Ic admin_account
  194. The user name of the instance administrator (optional).
  195. .It Ic short_description
  196. A textual short description about the instance (optional).
  197. .It Ic fastcgi
  198. If set to true,
  199. .Nm
  200. will use the FastCGI interface to communicate with the upper level
  201. http server, that must be configured accordingly.
  202. .It Ic disable_history
  203. If set to true, history monthly snapshots are not served nor their links shown.
  204. .It Ic shared_inboxes
  205. This boolean value selects if shared inboxes are announced or not. Enabling
  206. shared inboxes helps (somewhat) in optimizing incoming traffic for instances
  207. with a large number of users.
  208. .El
  209. .Pp
  210. You must restart the server to make effective these changes.
  211. .Pp
  212. If a file named
  213. .Pa greeting.html
  214. is present in the server base directory, it will be returned whenever
  215. the base URL of the server is requested. Fill it with whatever
  216. information about the instance you want to supply to people
  217. visiting the server, like sign up requirements, site policies
  218. and such. The special %userlist% mark in the file will cause
  219. the list of users in this instance to be inserted.
  220. .Pp
  221. Users can change a bit of information about themselves from the
  222. web interface. See
  223. .Xr snac 1
  224. for details. Further, every user can have a private CSS file in their
  225. .Pa static/style.css
  226. that will be served instead of the server-wide one.
  227. It's not modifiable from the web interface to avoid users
  228. shooting themselves in the foot by destroying everything.
  229. .Ss Old Data Purging
  230. From version 2.06, there is no longer a need to add a special
  231. cron job for purging old data, as this is managed internally.
  232. .Ss ActivityPub Support
  233. These are the following activities and objects that
  234. .Nm
  235. supports:
  236. .Bl -tag -width tenletters
  237. .It Vt Follow
  238. Complete support, on input and output.
  239. .It Vt Undo
  240. For
  241. .Vt Follow
  242. objects, on input and output.
  243. .It Vt Create
  244. For
  245. .Vt Note ,
  246. .Vt Question
  247. and
  248. .Vt Page
  249. objects, on input and output.
  250. .It Vt Accept
  251. For
  252. .Vt Follow
  253. objects, on input and output.
  254. .It Vt Like
  255. For
  256. .Vt Note
  257. objects, on input and output.
  258. .It Vt Announce
  259. For
  260. .Vt Note
  261. objects, on input and output.
  262. .It Vt Update
  263. For
  264. .Vt Person ,
  265. .Vt Note
  266. and
  267. .Vt Question
  268. objects, on input and output.
  269. .It Vt Delete
  270. Supported for
  271. .Vt Note
  272. and
  273. .Vt Tomsbtone
  274. objects on input, and for
  275. .Vt Note
  276. objects on output.
  277. .El
  278. .Pp
  279. The rest of activities and objects are dropped on input.
  280. .Pp
  281. There is partial support for
  282. .Vt OrderedCollection
  283. objects in the
  284. .Pa /outbox
  285. (with the last 20 entries of the local timeline shown). No pagination
  286. is supported. Intentionally, the
  287. .Pa /followers
  288. and
  289. .Pa /following
  290. paths return empty lists.
  291. .Ss Migrating from Mastodon
  292. User migration from different Fediverse instances is a pain in the ass
  293. that has been implemented everywhere as a kludgy afterthought. There is
  294. not much that can be done, other than importing the list of people you
  295. follow to your new
  296. .Nm
  297. account.
  298. .Pp
  299. To do this, download the user's list of accounts being followed (in CSV
  300. format) from the Mastodon web interface and execute this:
  301. .Bd -literal -offset indent
  302. awk -F, 'NR > 1 { print $1 }' /path/to/following_accounts.csv | \\
  303. xargs -n 1 snac follow $SNAC_BASEDIR $SNAC_USER
  304. .Ed
  305. .Ss Instance blocking
  306. Full instances can be blocked. This operation must be done from
  307. the command-line tool. See
  308. .Xr snac 1 .
  309. .Ss Other Considerations
  310. .Nm
  311. stores all the messages it receives as JSON files, which are usually
  312. bloated and filled with redundant information. Using a filesystem with
  313. file compression enabled (like btrfs or zfs) will probably be a good
  314. choice to store the
  315. .Nm
  316. data storage into.
  317. .Sh ENVIRONMENT
  318. .Bl -tag -width Ds
  319. .It Ev DEBUG
  320. Overrides the debugging level from the server 'dbglevel' configuration
  321. variable. Set it to an integer value. The higher, the deeper in meaningless
  322. verbiage you'll find yourself into.
  323. .El
  324. .Sh EXAMPLES
  325. You want to install the
  326. .Nm
  327. Fediverse daemon in the host example.com, that is correctly configured
  328. with a valid TLS certificate and running the nginx httpd server.
  329. The service will be installed under the
  330. .Pa fedi
  331. location. Two users, walter and jessie, will be hosted in the system.
  332. Their Fediverse presence addresses will be
  333. .Lk https://example.com/fedi/walter
  334. and
  335. .Lk https://example.com/fedi/jesse ,
  336. respectively. They will be known
  337. in the Fediverse as @walter@example.com and @jesse@example.com. The
  338. .Nm
  339. daemon will run as the user snacusr in the system and listen to the
  340. localhost:8001 network socket. All data will be stored in the
  341. .Pa /home/snacusr/fedidata
  342. directory.
  343. .Pp
  344. Log into the system as snacusr and execute:
  345. .Bd -literal -offset indent
  346. snac init /home/snacusr/fedidata
  347. .Ed
  348. .Pp
  349. Answer "example.com" to the host name question, "/fedi" to the path
  350. prefix question, "localhost" to the address and "8001" to the port.
  351. .Pp
  352. Create the users
  353. .Bd -literal -offset indent
  354. snac adduser /home/snacusr/fedidata walter
  355. snac adduser /home/snacusr/fedidata jesse
  356. .Ed
  357. .Pp
  358. Answer the questions with reasonable values.
  359. .Pp
  360. Execute the server:
  361. .Bd -literal -offset indent
  362. snac httpd /home/snacusr/fedidata
  363. .Ed
  364. .Pp
  365. Edit the nginx configuration and add the following snippet to the
  366. example.com server section:
  367. .Bd -literal -offset indent
  368. # nginx configuration example
  369. # main web access point
  370. location /fedi {
  371. proxy_pass http://localhost:8001;
  372. proxy_set_header Host $http_host;
  373. }
  374. # webfinger
  375. location /.well-known/webfinger {
  376. proxy_pass http://localhost:8001;
  377. proxy_set_header Host $http_host;
  378. }
  379. # Mastodon API (entry points)
  380. location /api/v1/ {
  381. proxy_pass http://localhost:8001;
  382. proxy_set_header Host $http_host;
  383. }
  384. location /api/v2/ {
  385. proxy_pass http://localhost:8001;
  386. proxy_set_header Host $http_host;
  387. }
  388. # Mastodon API (OAuth support)
  389. location /oauth {
  390. proxy_pass http://localhost:8001;
  391. proxy_set_header Host $http_host;
  392. }
  393. # optional
  394. location /.well-known/nodeinfo {
  395. proxy_pass http://localhost:8001;
  396. proxy_set_header Host $http_host;
  397. }
  398. # optional (needed by some Mastodon API clients)
  399. location /.well-known/host-meta {
  400. proxy_pass http://localhost:8001;
  401. proxy_set_header Host $http_host;
  402. }
  403. .Ed
  404. .Pp
  405. Restart the nginx daemon and connect to
  406. .Lk https://example.com/fedi/walter .
  407. The empty, default screen will be shown. Enter the admin section with the
  408. credentials defined for this user. Search people, start following
  409. them, engage in arid discussions and generally enjoy the frustrating
  410. experience of Social Media.
  411. .Pp
  412. This is an example of a similar configuration for the Apache2 web server:
  413. .Bd -literal -offset indent
  414. # apache2 configuration example
  415. ProxyPreserveHost On
  416. # Main web access point
  417. <Location /social>
  418. ProxyPass http://127.0.0.1:8001/social
  419. </Location>
  420. # WebFinger
  421. <Location /.well-known/webfinger>
  422. ProxyPass http://127.0.0.1:8001/.well-known/webfinger
  423. </Location>
  424. # Mastodon API (entry points)
  425. <Location /api/v1/>
  426. ProxyPass http://127.0.0.1:8001/api/v1/
  427. </Location>
  428. <Location /api/v2/>
  429. ProxyPass http://127.0.0.1:8001/api/v2/
  430. </Location>
  431. # Mastodon API (OAuth support)
  432. <Location /oauth>
  433. ProxyPass http://127.0.0.1:8001/oauth
  434. </Location>
  435. # NodeInfo (optional)
  436. <Location /.well-known/nodeinfo>
  437. ProxyPass http://127.0.0.1:8001/.well-known/nodeinfo
  438. </Location>
  439. # host-meta (optional, needed for some Mastodon API clients)
  440. <Location /.well-known/host-meta>
  441. ProxyPass http://127.0.0.1:8001/.well-known/host-meta
  442. </Location>
  443. .Ed
  444. .Pp
  445. Since version 2.43,
  446. .Nm
  447. supports communicating from / to the front end http server using the FastCGI
  448. protocol. There is no special advantage in using this, only that some servers
  449. allow for simpler configuration. For example, in the case of nginx, you can
  450. replace the two 'proxy_pass' and 'proxy_set_header' lines in the example
  451. above with just
  452. .Bd -literal -offset indent
  453. fastcgi_pass localhost:8001;
  454. .Ed
  455. .Pp
  456. The only thing to change on
  457. .Nm
  458. size is to the set 'fastcgi' value to true in
  459. .Pa server.json .
  460. .Pp
  461. Further, using the FastCGI interface allows a much simpler configuration
  462. under OpenBSD's native httpd, given that it's natively implemented there
  463. and you no longer need to configure the complicated relayd server. This is
  464. an example:
  465. .Bd -literal -offset indent
  466. # OpenBSD httpd configuration example
  467. # other server configuration
  468. [...]
  469. location "/fedi*" {
  470. fastcgi socket tcp "127.0.0.1" 8001
  471. }
  472. location "/.well-known/webfinger" {
  473. fastcgi socket tcp "127.0.0.1" 8001
  474. }
  475. location "/oauth/*" {
  476. fastcgi socket tcp "127.0.0.1" 8001
  477. }
  478. location "/api/v1/*" {
  479. fastcgi socket tcp "127.0.0.1" 8001
  480. }
  481. location "/api/v2/*" {
  482. fastcgi socket tcp "127.0.0.1" 8001
  483. }
  484. location "/.well-known/nodeinfo" {
  485. fastcgi socket tcp "127.0.0.1" 8001
  486. }
  487. location "/.well-known/host-meta" {
  488. fastcgi socket tcp "127.0.0.1" 8001
  489. }
  490. .Ed
  491. .Sh SEE ALSO
  492. .Xr snac 1 ,
  493. .Xr snac 5
  494. .Sh AUTHORS
  495. .An grunfink Lk https://comam.es/snac/grunfink @grunfink@comam.es
  496. .Sh LICENSE
  497. See the LICENSE file for details.
  498. .Sh CAVEATS
  499. JSON files are fragile when modified by hand. Take care.