properties of the integral (Rudin theorem 6.12c)
Counterexample from Counterexamples in Analysis: "functions $f$ and $\alpha$ such that $f$ is Riemann-Stieltjes integrable with respect to $\alpha$ on both $[a,b]$ and $[b,c]$, but not on $[a,c]$". Let be $$f(x) = 0,\ 0\le x<1,\qquad f(x) = 1,\ 1\le x\le 2.$$ $$\alpha(x) = 0,\ 0\le x\le 1,\qquad \alpha(x) = 1,\ 1< x\le 2.$$ Then, $$\int_0^1 f\,d\alpha = 0,\qquad\int_1^2 f\,d\alpha = 1$$ and $$\int_0^2 f\,d\alpha$$ does not exist.
The problem boils down to a proper definition of Riemann-Stieltjes definition. In this case Tom M. Apostol gives much better description (in his Mathematical Analysis) compared to Walter Rudin (in his Principles of Mathematical Analysis).
Definition 1: Let $P = \{x_{0}, x_{1}, x_{2},\ldots, x_{n}\}$ be a partition of interval $[a, b]$ and let $t_{k}$ be a point in the sub-interval $[x_{k - 1}, x_{k}]$. Let $f$ and $\alpha$ be functions defined and bounded on $[a, b]$. A sum of the form $$S(P, f, \alpha) = \sum_{k = 1}^{n}f(t_{k})\{\alpha(x_{k}) - \alpha(x_{k - 1})\}$$ is called a Riemann-Stieltjes sum of $f$ with respect to $\alpha$ on $[a, b]$. We say that $f$ is Riemann integrable with respect to $\alpha$ on $[a, b]$, and we write "$f \in R(\alpha)$ on $[a, b]$" if there exists a number $I$ having the following property: For every $\epsilon > 0$ there exists a parition $P_{\epsilon}$ of $[a, b]$ such that for all partitions $P = \{x_{0}, x_{1}, x_{2},\ldots, x_{n}\}$ of $[a, b]$ with $P \supseteq P_{\epsilon}$ and for every choice of $t_{k} \in [x_{k -1}, x_{k}]$ we have $$|S(P, f, \alpha) - I| < \epsilon$$
When $\alpha$ is monotone on $[a, b]$ this definition coincides with the one based on upper and lower integrals given by Rudin.
Apostol mentions another definition of Riemann-Stieltjes integral in the exercises (Problem 7.3, page 174, Mathematical Analysis):
Definition 2: Let $f$ and $\alpha$ be defined and bounded on $[a, b]$. We say that $f$ is Riemann integrable with respect to $\alpha$ on $[a, b]$, and we write "$f \in R(\alpha)$ on $[a, b]$" if there exists a number $I$ having the following property: For every $\epsilon > 0$ there exists a number $\delta > 0$ such that for all partitions $P = \{x_{0}, x_{1}, x_{2}, \ldots, x_{n}\}$ of $[a, b]$ with norm $||P|| = \max_{k = 1}^{n}(x_{k} - x_{k - 1})< \delta$ and any choice of points $t_{k} \in [x_{k - 1}, x_{k}]$ we have $$|S(P, f, \alpha) - I| < \epsilon$$
Definition 1 is more general than definition 2 in the sense that if $f \in R(\alpha)$ on $[a, b]$ based on definition 2 then $f \in R(\alpha)$ on $[a, b]$ based on definition 1, but there are functions $f, \alpha$ such that $f \in R(\alpha)$ on $[a, b]$ according to definition 1 and $f \notin R(\alpha)$ on $[a, b]$ based on definition 2. An example is given in Problem 7.3(b), Page 174, Apostol' Mathematical Analysis which is integrable according to definition 1, but not according to definition 2 (this example is incidentally the same as the one given by Martin in his answer to the current question).
Moreover if $\alpha(x) = x$ (so that we are just talking about plain Riemann integrability of $f$ on $[a, b]$) then both the definitions are equivalent (proof is not trivial/obvious and is given in Problem 7.4, page 174, Apostol's Mathematical Analysis).
Apostol uses definition 1 in his text and proves the following theorem:
Theorem: Assume that $c \in (a, b)$. If two of the integrals in the equation below exist, then the third also exists and we have $$\int_{a}^{c}f\,d\alpha + \int_{c}^{b}f\,d\alpha = \int_{a}^{b}f\,d\alpha$$
Moreover at the end of this theorem Apostol mentions the following note:
Note: The preceding type of argument cannot be used to prove that the integral $\int_{a}^{c}f\,d\alpha$ exists whenever $\int_{a}^{b}f\,d\alpha$ exists. The conclusion is correct however.
Apostol gives proof of existence of $\int_{a}^{c}f\,d\alpha$ based on existence of $\int_{a}^{b}f\,d\alpha$ in case when $\alpha$ is of bounded variation on $[a, b]$. However the proof for general bounded function $\alpha$ is based on different idea (Cauchy's criterion of integrability of interval functions, see page 22, Functional Analysis by F. Riesz and B. Nagy).
Based on definition 1, the claim by OP is correct. Also the counter-example by Martin in his answer is wrong. But if we use definition 2, then Martin's counter-example is correct and OP's claim is wrong. Thus it is a matter of definitions. In my opinion one should use the more general definition 1 compared to the slightly restrictive (but the one given originally by Riemann) definition 2.