I'm trying to understand the whole issue with CSRF and appropriate ways to prevent it. (Resources I've read, understand, and agree with: OWASP CSRF Prevention Cheat Sheet, Questions about CSRF)

As I understand it, the vulnerability around CSRF is introduced by the assumption that (from the webserver's point of view) a valid session cookie in an incoming HTTP request reflects the wishes of an authenticated user. But all cookies for the origin domain are magically attached to the request by the browser, so really all the server can infer from the presence of a valid session cookie in a request is that the request comes from a browser which has an authenticated session; it cannot further assume anything about the code running in that browser, or whether it really reflects user wishes. The way to prevent this is to include additional authentication information (the "CSRF token") in the request, carried by some means other than the browser's automatic cookie handling. Loosely speaking, then, the session cookie authenticates the user/browser and the CSRF token authenticates the code running in the browser.

So in a nutshell, if you're using a session cookie to authenticate users of your web application, you should also add a CSRF token to each response, and require a matching CSRF token in each (mutating) request. The CSRF token then makes a roundtrip from server to browser back to server, proving to the server that the page making the request is approved by (generated by, even) that server.

On to my question, which is about the specific transport method used for that CSRF token on that roundtrip.

It seems common (e.g. in AngularJS, Django, Rails) to send the CSRF token from server to client as a cookie (i.e. in a Set-Cookie header), and then have Javascript in the client scrape it out of the cookie and attach it as a separate XSRF-TOKEN header to send back to the server.

(An alternate method is the one recommended by e.g. Express, where the CSRF token generated by the server is included in the response body via server-side template expansion, attached directly to the code/markup that will supply it back to the server, e.g. as a hidden form input. That example is a more web 1.0-ish way of doing things, but would generalize fine to a more JS-heavy client.)

Why is it so common to use Set-Cookie as the downstream transport for the CSRF token / why is this a good idea? I imagine the authors of all these frameworks considered their options carefully and didn't get this wrong. But at first glance, using cookies to work around what's essentially a design limitation on cookies seems daft. In fact, if you used cookies as the roundtrip transport (Set-Cookie: header downstream for the server to tell the browser the CSRF token, and Cookie: header upstream for the browser to return it to the server) you would reintroduce the vulnerability you are trying to fix.

I realize that the frameworks above don't use cookies for the whole roundtrip for the CSRF token; they use Set-Cookie downstream, then something else (e.g. a X-CSRF-Token header) upstream, and this does close off the vulnerability. But even using Set-Cookie as the downstream transport is potentially misleading and dangerous; the browser will now attach the CSRF token to every request including genuine malicious XSRF requests; at best that makes the request bigger than it needs to be and at worst some well-meaning but misguided piece of server code might actually try to use it, which would be really bad. And further, since the actual intended recipient of the CSRF token is client-side Javascript, that means this cookie can't be protected with http-only. So sending the CSRF token downstream in a Set-Cookie header seems pretty suboptimal to me.

A good reason, which you have sort of touched on, is that once the CSRF cookie has been received, it is then available for use throughout the application in client script for use in both regular forms and AJAX POSTs. This will make sense in a JavaScript heavy application such as one employed by AngularJS (using AngularJS doesn't require that the application will be a single page app, so it would be useful where state needs to flow between different page requests where the CSRF value cannot normally persist in the browser).

Consider the following scenarios and processes in a typical application for some pros and cons of each approach you describe. These are based on the Synchronizer Token Pattern.

Request Body Approach

1. User successfully logs in.
2. Server issues auth cookie.
3. User clicks to navigate to a form.
4. If not yet generated for this session, server generates CSRF token, stores it against the user session and outputs it to a hidden field.
5. User submits form.
6. Server checks hidden field matches session stored token.

Advantages:

• Simple to implement.
• Works with AJAX.
• Works with forms.
• Cookie can actually be HTTP Only.

Disadvantages:

• All forms must output the hidden field in HTML.
• Any AJAX POSTs must also include the value.
• The page must know in advance that it requires the CSRF token so it can include it in the page content so all pages must contain the token value somewhere, which could make it time consuming to implement for a large site.

Custom HTTP Header (downstream)

1. User successfully logs in.
2. Server issues auth cookie.
3. User clicks to navigate to a form.
4. Page loads in browser, then an AJAX request is made to retrieve the CSRF token.
5. Server generates CSRF token (if not already generated for session), stores it against the user session and outputs it to a header.
6. User submits form (token is sent via hidden field).
7. Server checks hidden field matches session stored token.

Advantages:

• Works with AJAX.
• Cookie can be HTTP Only.

Disadvantages:

• Doesn't work without an AJAX request to get the header value.
• All forms must have the value added to its HTML dynamically.
• Any AJAX POSTs must also include the value.
• The page must make an AJAX request first to get the CSRF token, so it will mean an extra round trip each time.
• Might as well have simply output the token to the page which would save the extra request.

Custom HTTP Header (upstream)

1. User successfully logs in.
2. Server issues auth cookie.
3. User clicks to navigate to a form.
4. If not yet generated for this session, server generates CSRF token, stores it against the user session and outputs it in the page content somewhere.
5. User submits form via AJAX (token is sent via header).
6. Server checks custom header matches session stored token.

Advantages:

• Works with AJAX.
• Cookie can be HTTP Only.

Disadvantages:

• Doesn't work with forms.
• All AJAX POSTs must include the header.

Custom HTTP Header (upstream & downstream)

1. User successfully logs in.
2. Server issues auth cookie.
3. User clicks to navigate to a form.
4. Page loads in browser, then an AJAX request is made to retrieve the CSRF token.
5. Server generates CSRF token (if not already generated for session), stores it against the user session and outputs it to a header.
6. User submits form via AJAX (token is sent via header) .
7. Server checks custom header matches session stored token.

Advantages:

• Works with AJAX.
• Cookie can be HTTP Only.

Disadvantages:

• Doesn't work with forms.
• All AJAX POSTs must also include the value.
• The page must make an AJAX request first to get the CRSF token, so it will mean an extra round trip each time.

Set-Cookie

1. User successfully logs in.
2. Server issues auth cookie.
3. User clicks to navigate to a form.
4. Server generates CSRF token, stores it against the user session and outputs it to a cookie.
5. User submits form via AJAX or via HTML form.
6. Server checks custom header (or hidden form field) matches session stored token.
7. Cookie is available in browser for use in additional AJAX and form requests without additional requests to server to retrieve the CSRF token.

Advantages:

• Simple to implement.
• Works with AJAX.
• Works with forms.
• Doesn't necessarily require an AJAX request to get the cookie value. Any HTTP request can retrieve it and it can be appended to all forms/AJAX requests via JavaScript.
• Once the CSRF token has been retrieved, as it is stored in a cookie the value can be reused without additional requests.

Disadvantages:

• All forms must have the value added to its HTML dynamically.
• Any AJAX POSTs must also include the value.
• The cookie will be submitted for every request (i.e. all GETs for images, CSS, JS, etc, that are not involved in the CSRF process) increasing request size.
• Cookie cannot be HTTP Only.

So the cookie approach is fairly dynamic offering an easy way to retrieve the cookie value (any HTTP request) and to use it (JS can add the value to any form automatically and it can be employed in AJAX requests either as a header or as a form value). Once the CSRF token has been received for the session, there is no need to regenerate it as an attacker employing a CSRF exploit has no method of retrieving this token. If a malicious user tries to read the user's CSRF token in any of the above methods then this will be prevented by the Same Origin Policy. If a malicious user tries to retrieve the CSRF token server side (e.g. via curl) then this token will not be associated to the same user account as the victim's auth session cookie will be missing from the request (it would be the attacker's - therefore it won't be associated server side with the victim's session).

As well as the Synchronizer Token Pattern there is also the Double Submit Cookie CSRF prevention method, which of course uses cookies to store a type of CSRF token. This is easier to implement as it does not require any server side state for the CSRF token. The CSRF token in fact could be the standard authentication cookie when using this method, and this value is submitted via cookies as usual with the request, but the value is also repeated in either a hidden field or header, of which an attacker cannot replicate as they cannot read the value in the first place. It would be recommended to choose another cookie however, other than the authentication cookie so that the authentication cookie can be secured by being marked HttpOnly. So this is another common reason why you'd find CSRF prevention using a cookie based method.