I can't speak to how
you should decide whether or not a sequel is prudent, but I can tell you how
I decide to continue a series. It's really not an artistic decision for me at this point; it's a business decision. I'm the sole income earner in my household. I just can't afford to prioritize my personal (totally arbitrary) concept of artistic integrity.
So here are a few of the factors I consider:
I know about how much it costs for me to produce a novel. I also know how much money I need to make off of all of my books combined in a month to "break even" on life and business expenses. So, generally, my new book needs to not only sell enough to cover its own production costs, but improve the sales on older titles, so that I hit this magical break even number.
I know how many people are on my mailing list and Facebook, who provide the majority of my initial sales, and I know what % of increase I've seen on those since the last time I released a title. So I can guesstimate from those numbers how much I will sell on a new release in one week (which varies between individual series, and is lower for new projects unrelated to existing series). I also keep track of conversion stats for release announcements, so I can always look back to that. For instance, 50% of people who click on the link in the email will buy it immediately; 70% of people who click on the link on Facebook will buy it immediately. And I have historical numbers on clicks as well.
I keep track of sell-through on my series, so I can also project how much a new book in that series will sell within a certain time frame. My next release is in my Cain Chronicles series, and this is what sell-through looks like on that:
Episode 1 > 2: 79%
Episode 2 > 3: 99%
Episode 3 > 4: 99%
My mailing list has increased 24% since the last episode came out. I could guess that I'll sell about 24% more of episode 5 than episode 4, in the first week. But in the slightly longer term, I'd say sales of episode 5 will still be somewhere around 99% of the sales of episode 4 after 6 weeks, if all factors were to remain consistent. It won't be consistent, though--the price will be higher, since episode 5 is actually a full-length book; it's been a longer period of time since I released the last one (two months versus two weeks); my overall reach has grown significantly since episode 4 came out. It does give me a number to work off of, though, and I can project units sold and earnings from there.
All of this also influences the price I choose for a new release, and estimates on royalties earned. By comparing statistics on my two separate series branches--YA/NA PNR series versus adult UF series--I can plan out the timing of releases, as well as
what releases I need to make, so that I'm always hitting that monthly "magic number." Or at least, doing my darndest. This is all pretty much guesswork, in the end. But it's very educated guesswork!
Oh, but just to prove myself a hypocrite...my UF series only sells about 1/3 of what my YA/NA books do. I keep writing those anyway, even though they're longer and more energy-intensive. Why? Because they're fun! I love my UF books.

As long as I'm still operating within reasonable profit margins (I pretty much expect my UF books to earn 300% of money invested in three months, whereas my other books do some other number I don't feel like calculating, but it's better), I'll keep writing the less-profitable stuff that I love.
I am really tired, so I hope that post made some semblance of sense.