{"id":13032,"date":"2020-01-13T15:03:39","date_gmt":"2020-01-13T14:03:39","guid":{"rendered":"https:\/\/daniel.haxx.se\/blog\/?p=13032"},"modified":"2020-01-13T16:10:49","modified_gmt":"2020-01-13T15:10:49","slug":"curl-ootw-raw","status":"publish","type":"post","link":"https:\/\/daniel.haxx.se\/blog\/2020\/01\/13\/curl-ootw-raw\/","title":{"rendered":"curl ootw: –raw"},"content":{"rendered":"\n

(ootw is short for “option of the week<\/a>“!)<\/p>\n\n\n\n

--raw<\/code><\/h2>\n\n\n\n

Introduced back in April of 2007 in curl 7.16.2<\/a>, the man page details<\/a> for this option is very brief:<\/p>\n\n\n\n

(HTTP) When used, it disables all internal HTTP decoding of content or transfer encodings and instead makes them passed on unaltered, raw. <\/p><\/blockquote>\n\n\n\n

This option is for HTTP(S) and it was brought to curl when someone wanted to use curl in a proxy solution. In that setup the user parsed the incoming headers and acted on them and in the case where for example chunked encoded<\/a> data is received, which curl then automatically “decodes” so that it can deliver the pure clean data, the user would find that there were headers in the received response that says “chunked” but since libcurl had already decoded the body, it wasn’t actually still chunked when it landed!<\/p>\n\n\n\n

In the libcurl side, an application can explicitly switch off this, by disabling transfer and content encoding with CURLOPT_HTTP_TRANSFER_DECODING<\/a> and CURLOPT_HTTP_CONTENT_DECODING<\/a>.<\/p>\n\n\n\n

The --raw<\/code> option is the command line version that disable both of those at once.<\/p>\n\n\n\n

With --raw<\/code>, no transfer or content decoding is done and the “raw” stream is instead delivered or saved. You really only do this if you for some reason want to handle those things yourself instead.<\/p>\n\n\n\n

Content decoding includes automatice gzip compression, so --raw<\/code> will also disable that, even if you use --compressed<\/code>.<\/p>\n\n\n\n

It should be noted that chunked encoding is a HTTP\/1.1 thing. We don’t do that anymore in HTTP\/2 and later – and curl will default to HTTP\/2 over HTTPS if possible since a while back. Users can also often avoid chunked encoded responses by insisting on HTTP\/1.0, like with the --http1.0<\/a><\/code> option (since chunked wasn’t included in 1.0).<\/p>\n\n\n\n

Example command line<\/h2>\n\n\n\n
curl --raw https:\/\/example.com\/dyn-content.cgi<\/pre>\n\n\n\n
Related options<\/h2>\n\n\n\n
--compressed<\/a><\/code> asks the server to provide the response compressed and curl will then decompress it automatically. Thus reduce the amount of data that gets sent over the wire.<\/p>\n","protected":false},"excerpt":{"rendered":"
(ootw is short for “option of the week“!) –raw Introduced back in April of 2007 in curl 7.16.2, the man page details for this option is very brief: (HTTP) When used, it disables all internal HTTP decoding of content or transfer encodings and instead makes them passed on unaltered, raw. This option is for HTTP(S) … Continue reading curl ootw: –raw<\/span> →<\/span><\/a><\/p>\n","protected":false},"author":5,"featured_media":13041,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[33,486],"class_list":["post-13032","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-curl","tag-curl-and-libcurl","tag-option-of-the-week"],"_links":{"self":[{"href":"https:\/\/daniel.haxx.se\/blog\/wp-json\/wp\/v2\/posts\/13032","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/daniel.haxx.se\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/daniel.haxx.se\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/daniel.haxx.se\/blog\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/daniel.haxx.se\/blog\/wp-json\/wp\/v2\/comments?post=13032"}],"version-history":[{"count":12,"href":"https:\/\/daniel.haxx.se\/blog\/wp-json\/wp\/v2\/posts\/13032\/revisions"}],"predecessor-version":[{"id":13202,"href":"https:\/\/daniel.haxx.se\/blog\/wp-json\/wp\/v2\/posts\/13032\/revisions\/13202"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/daniel.haxx.se\/blog\/wp-json\/wp\/v2\/media\/13041"}],"wp:attachment":[{"href":"https:\/\/daniel.haxx.se\/blog\/wp-json\/wp\/v2\/media?parent=13032"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/daniel.haxx.se\/blog\/wp-json\/wp\/v2\/categories?post=13032"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/daniel.haxx.se\/blog\/wp-json\/wp\/v2\/tags?post=13032"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}