To back up everything from a normal install on Windows, you need to back up the two folders you mention plus your ProgramData/Bible Analyzer folder and your User files folder. You can find both of these by going to Tools/Display Primary Modules Folder and Tools/Display User Data Folder in Bible Analyzer.
Developer, Bible Analyzer
But to him that worketh not, but believeth on him that justifieth the ungodly, his faith is counted for righteousness. (Rom 4:5 AV)