Context: Kiriu Doushirou 桐柳道士郎 was born in Japan but raised in Nevada, U.S.A., as a Japanese samurai, who likes having honorable battles and stuff like that, except that:
sesshaφ, {dare to demo shoubu suru} wake dewa gozaran. 拙者、誰とでも勝負するわけではござらん。 It's not like I {will compete with [just] anybody}.
shoubu - to compete against, to have a battle with, to fight with.
dewa gozaran - archaism, same meaning as dewa gozaimasen ではございません.
kuzu-domo towa sen no da. クズ共とはせんのだ。 [I] don't do [it] with scum.
In other words, Doushirou only competes with honorable people, against scum he just beats them up.