test: remove unnecessary `semver` calls #2304

Job	Run time
Test without ESLint Stylistic	2m 9s
Test with old ESLint Stylistic (3)	2m 10s
Test with old ESLint Stylistic (2)	2m 13s
Test with typescript-eslint v7	2m 23s
Lint	48s
Test with old ESLint Stylistic (4)	2m 16s
Test with ESLint v8	2m 20s
Test (18)	2m 25s
Test (lts/*)	2m 3s
Test (21)	2m 9s
Test (20)	2m 18s
	23m 14s

Provide feedback