{"id":15872,"date":"2019-06-12T15:15:39","date_gmt":"2019-06-12T15:15:39","guid":{"rendered":"https:\/\/www.bartbusschots.ie\/s\/?p=15872"},"modified":"2019-06-17T14:28:02","modified_gmt":"2019-06-17T14:28:02","slug":"bash-to-zsh-file-globbing-and-no-matches-found-errors","status":"publish","type":"post","link":"https:\/\/www.bartbusschots.ie\/s\/2019\/06\/12\/bash-to-zsh-file-globbing-and-no-matches-found-errors\/","title":{"rendered":"Bash to Zsh: File Globbing and ‘no matches found’ Errors"},"content":{"rendered":"
This entry is part 3 of 6 in the series Bash to Zsh<\/a><\/div><\/div><\/div>

At Apple’s recommendation<\/a> I’ve moved from Bash to Zsh on all my Macs. This has been a mostly smooth transition, but I have run into a handful of little gotchas<\/em>. This week it was an error when trying to execute a command I’d been using in Bash for years. The error started zsh: no matches found<\/code>.<\/p>\n

The cause of this error is a subtle but important difference in how Bash and Zsh handle file globbing (expansion of the *<\/code> character) when no files match the specified pattern. By default, Bash happily expands expressions that don’t match anything into an empty list. Zsh’s default behaviour is to raise an error and prevent the command executing.<\/p>\n

TL;DR<\/strong> \u00e2\u20ac\u201d setopt NULL_GLOB<\/code> to enable Bash-like behaviour, and unsetopt NULL_GLOB<\/code> to revert back to the Zsh-like behaviour.<\/p>\n

<\/p>\n

You can quickly and easily see the difference of behaviour by setting up a test folder with a few files in it like so:<\/p>\n

\r\nmkdir globDemo\r\ncd globDemo\r\ntouch index.html app1.js main.js main.css logo.png\r\n<\/pre>\n
This will create a folder named globDemo<\/code>, change into it, and then create the following (empty) files:<\/p>\n
\r\napp1.js\r\nindex.html\r\nlogo.png\r\nmain.css\r\nmain.js\r\n<\/pre>\n
This is a realistic set of files for a very basic web app. You might also realistically have a ZIP command for archiving these files that you somehow save and regularly re-use (perhaps as a TextExpander snippet). That command could try to archive all files of the common web types into a single file. The following would be reasonable:<\/p>\n
\r\nzip webArchive.zip *.html *.css *.js *.png *.jpeg\r\n<\/pre>\n
This command tries to archive all HTML, CSS, JavaScript, PNG & JPEG files into a ZIP file named webArchive.zip<\/code>. Some sites will have files of all of those types, but others won’t. That means that sometimes some of those *<\/code> expressions (file globs) will not match any files.<\/p>\n
In our demo folder there are HTML, CSS, JavaScript, and PNG files, but no JPEG files. If we run the ZIP command in Bash within our demo folder it gives a warning to let us know one of our globs didn’t match anything, but the command still gets executed and it works just fine:<\/p>\n
\"\"<\/p>\n
So what happens when we run exactly the same command in Zsh? <\/p>\n
\"\"<\/p>\n
As you can see, we get the error zsh: no matches found: *.jpeg<\/code> because our folder doesn’t contain any JPEG files. Unlike the warning form Bash, this is an error, so the command does not execute, and the ZIP does not get created.<\/p>\n
Zsh’s NULL_GLOB<\/code> Option<\/h2>\n
What Zsh does when a glob doesn’t expand to anything is controlled by the NULL_GLOB<\/code> option. This option is un-set by default. You can set it with the command setopt NULL_GLOB<\/code>, and you can un-set it with unsetopt NULL_GLOB<\/code>.<\/p>\n
If you set this option then Zsh behaves more like Bash, though without showing an explicit warning:<\/p>\n
\"\"<\/p>\n
A Permanent Fix?<\/h2>\n
You could choose to always enable this behaviour by adding the the setopt<\/code> command into your ~\/.zshrc<\/code> file:<\/p>\n
\r\n# don't throw errors when file globs don't match anything\r\nsetopt NULL_GLOB\r\n<\/pre>\n
I’d suggest not doing this because the Zsh people didn’t make this change arbitrarily, they put a lot of thought into it, and decided that on balance, the new behaviour is safer. Many commands won’t do what you expect if a glob expands to an empty list. Also, it’s reasonable to assume that most of the time, we expect our globs to expand out to at least one file, so if they don’t something probably went wrong!<\/p>\n
By far the simplest and least-invasive solution is to update any saved commands so they are wrapped by a setopt<\/code> and an unsetopt<\/code>. I.e., we would update our example command as follows:<\/p>\n
\r\nsetopt NULL_GLOB; zip webArchive.zip *.html *.css *.js *.png *.jpeg; unsetopt NULL_GLOB\r\n<\/pre>\n
\"\"<\/p>\n
An Interesting Middle-ground \u00e2\u20ac\u201d CSH_NULL_GLOB<\/code><\/h2>\n
The C Shell<\/a> (csh) takes an interesting alternative approach to both Bash and Zsh \u00e2\u20ac\u201d it will throw an error like Zsh, but only of all<\/strong> the globs in a given command return an empty list. This prevents empty lists causing un-expected behaviour, and, it would not throw an error in our example because all the globs other than *.jpeg<\/code> do match at least one file.<\/p>\n
Thankfully the Zsh developers were paying attention, and they have provided an option for enabling C Shell-like behaviour in Zsh! The option is pretty well named too \u00e2\u20ac\u201d CSH_NULL_GLOB<\/code>. As you might expect, you can enable this option with the command setopt CSH_NULL_GLOB<\/code>:<\/p>\n
\"\"<\/p>\n
If you prefer not to have to wrap commands like suggested above, perhaps adding the following to your ~\/.zshrc<\/code> might be a good alternative:<\/p>\n
\r\n# only throw errors when no globs match anything\r\nsetopt CSH_NULL_GLOB\r\n<\/pre>\n","protected":false},"excerpt":{"rendered":"
This entry is part 3 of 6 in the series Bash to Zsh<\/a><\/div><\/div><\/div>
At Apple’s recommendation I’ve moved from Bash to Zsh on all my Macs. This has been a mostly smooth transition, but I have run into a handful of little gotchas. This week it was an error when trying to execute a command I’d been using in Bash for years. The error started zsh: no matches […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[12,446],"tags":[406,458,580],"series":[581],"class_list":["post-15872","post","type-post","status-publish","format-standard","hentry","category-computers-tech","category-sysadmin","tag-commandline","tag-tutorial","tag-zsh","series-bash-to-zsh"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p7t9xK-480","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.bartbusschots.ie\/s\/wp-json\/wp\/v2\/posts\/15872","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.bartbusschots.ie\/s\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bartbusschots.ie\/s\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bartbusschots.ie\/s\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bartbusschots.ie\/s\/wp-json\/wp\/v2\/comments?post=15872"}],"version-history":[{"count":4,"href":"https:\/\/www.bartbusschots.ie\/s\/wp-json\/wp\/v2\/posts\/15872\/revisions"}],"predecessor-version":[{"id":15883,"href":"https:\/\/www.bartbusschots.ie\/s\/wp-json\/wp\/v2\/posts\/15872\/revisions\/15883"}],"wp:attachment":[{"href":"https:\/\/www.bartbusschots.ie\/s\/wp-json\/wp\/v2\/media?parent=15872"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bartbusschots.ie\/s\/wp-json\/wp\/v2\/categories?post=15872"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bartbusschots.ie\/s\/wp-json\/wp\/v2\/tags?post=15872"},{"taxonomy":"series","embeddable":true,"href":"https:\/\/www.bartbusschots.ie\/s\/wp-json\/wp\/v2\/series?post=15872"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}