uBlock/tools/make-assets.sh

#!/usr/bin/env bash
#
# This script assumes a linux environment

set -e

DES=$1/assets

echo "*** Packaging assets in $DES... "

rm -rf $DES
cp -R ./assets $DES/

mkdir $DES/thirdparties

ASSETS_MAIN=dist/build/uAssets/main
ASSETS_PROD=dist/build/uAssets/prod

cp -R $ASSETS_MAIN/thirdparties/pgl.yoyo.org     $DES/thirdparties/
cp -R $ASSETS_MAIN/thirdparties/publicsuffix.org $DES/thirdparties/
cp -R $ASSETS_MAIN/thirdparties/urlhaus-filter   $DES/thirdparties/

mkdir -p $DES/thirdparties/easylist
cp $ASSETS_PROD/thirdparties/easylist.txt $DES/thirdparties/easylist/
cp $ASSETS_PROD/thirdparties/easyprivacy.txt $DES/thirdparties/easylist/

mkdir $DES/ublock
cp $ASSETS_PROD/filters/* $DES/ublock/

# Do not include in package
rm $DES/ublock/annoyances.txt
rm $DES/ublock/lan-block.txt
rm $DES/ublock/ubol-filters.txt
Revert "Pass -e flag to bash (#3790)" This reverts commit bb2015949516346edb137384882022f839a187d2. 2021-07-31 20:49:32 +02:00			`#!/usr/bin/env bash`
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 19:07:46 +02:00			`#`
			`# This script assumes a linux environment`

Use set -e in Bash scripts (#3791) 2021-07-31 23:34:25 +02:00			`set -e`

update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 19:07:46 +02:00			`DES=$1/assets`

Remove requirement of uAssets presence to build a package Related discussion: - https://github.com/cliqz-oss/adblocker/pull/2075#discussion_r678654293 2021-07-29 01:40:11 +02:00			`echo "*** Packaging assets in $DES... "`
this fixes travis? 2016-04-03 20:25:56 +02:00
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 19:07:46 +02:00			`rm -rf $DES`
Finalize converting resources.txt into immutable resources With hindsight, I revised decisions made earlier during this development cycle: Un-redirectable scriptlets have been removed from /web_accessible_resources and instead put in the new /assets/resources/scriptlets.js, which contains all scriptlets used for web page injection purpose. uBO will no longer fetch a remote version of built-in resources. Advanced setting `userResourcesLocation` will still be honoured by uBO, and if set, will be fetched every time at least one asset is updated. 2019-07-06 18:36:28 +02:00			`cp -R ./assets $DES/`
Leverage whotracks.me's huge dataset of URLs for benchmark purpose As seen at: https://whotracks.me/blog/adblockers_performance_study.html The requests.json.gz file can be downloaded from: https://cdn.cliqz.com/adblocking/requests_top500.json.gz Copy the file into ./tmp/requests.json.gz If the file is present when you build uBO using `make-[target].sh` from the shell, the resulting package will contain `./assets/requests.json`, which will be looked-up by the method below to launch a benchmark session. From uBO's dev console, launch the benchmark: µBlock.staticNetFilteringEngine.benchmark(); The usual browser dev tools can be used to obtain useful profiling data, i.e. start the profiler, call the benchmark method from the console, then stop the profiler when it completes. Keep in mind that the measurements at the blog post above where obtained with ONLY EasyList. The CPU reportedly used was: https://www.cpubenchmark.net/cpu.php?cpu=Intel+Core+i7-6600U+%40+2.60GHz&id=2608 Rename ./tmp/requests.json.gz to something else if you no longer want ./assets/requests.json in the build. 2019-02-15 22:18:03 +01:00
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 19:07:46 +02:00			`mkdir $DES/thirdparties`
Remove requirement of uAssets presence to build a package Related discussion: - https://github.com/cliqz-oss/adblocker/pull/2075#discussion_r678654293 2021-07-29 01:40:11 +02:00
Use `git clone` instead of submodule to pull uAssets dependencies Related issue: - https://github.com/uBlockOrigin/uBlock-issues/issues/2358 We need two different branches of uAssets to properly add the default filter lists into the packages. I couldn't figure out how to do this with submodules, using simple `git clone` as a dependency just work. 2022-11-14 15:50:53 +01:00			`ASSETS_MAIN=dist/build/uAssets/main`
			`ASSETS_PROD=dist/build/uAssets/prod`
Remove requirement of uAssets presence to build a package Related discussion: - https://github.com/cliqz-oss/adblocker/pull/2075#discussion_r678654293 2021-07-29 01:40:11 +02:00
Use `git clone` instead of submodule to pull uAssets dependencies Related issue: - https://github.com/uBlockOrigin/uBlock-issues/issues/2358 We need two different branches of uAssets to properly add the default filter lists into the packages. I couldn't figure out how to do this with submodules, using simple `git clone` as a dependency just work. 2022-11-14 15:50:53 +01:00			`cp -R $ASSETS_MAIN/thirdparties/pgl.yoyo.org $DES/thirdparties/`
			`cp -R $ASSETS_MAIN/thirdparties/publicsuffix.org $DES/thirdparties/`
			`cp -R $ASSETS_MAIN/thirdparties/urlhaus-filter $DES/thirdparties/`

			`mkdir -p $DES/thirdparties/easylist`
Pick only the packaged lists 2023-04-27 19:22:15 +02:00			`cp $ASSETS_PROD/thirdparties/easylist.txt $DES/thirdparties/easylist/`
			`cp $ASSETS_PROD/thirdparties/easyprivacy.txt $DES/thirdparties/easylist/`
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 19:07:46 +02:00
			`mkdir $DES/ublock`
Use `git clone` instead of submodule to pull uAssets dependencies Related issue: - https://github.com/uBlockOrigin/uBlock-issues/issues/2358 We need two different branches of uAssets to properly add the default filter lists into the packages. I couldn't figure out how to do this with submodules, using simple `git clone` as a dependency just work. 2022-11-14 15:50:53 +01:00			`cp $ASSETS_PROD/filters/* $DES/ublock/`

			`# Do not include in package`
			`rm $DES/ublock/annoyances.txt`
			`rm $DES/ublock/lan-block.txt`
			`rm $DES/ublock/ubol-filters.txt`