OUTDOOR SCENE LABELLING WITH LEARNED FEATURES AND REGION CONSISTENCY ACTIVATION
Yandong Li
1,2
, Ferdous Sohel
2
, Mohammed Bennamoun
2
, Hang Lei
1
1
University of Electronic Science and Technology of China (UESTC),
2
The University of Western Australia (UWA)
1. Introduction
Fig. 1. Top Left: Original image. Top
Right: Ground truth labels of the
original image. Bottom Left: Labelled
image using learned features from
ConvNets. Bottom Right: Scene
labelling with the proposed Region
Consistency Activation (RCA).
1.1 Objective of scene
labelling
1.2 Challenges of scene
labelling
1.3 Our main contributions
2. Background
2.1 Classic strategies for scene labelling
!
"
!
#
!
$
"%
!
#&'()*+)$",
!
'-.-/
#
!
0-1'
!
1'
2.2 Recent development in scene labelling
%
2%-./
3. Method
Fig. 2. Block diagram of our proposed scene labelling framework
"13
4134'5
3.1 Multiscale superpixel representation
#&
#&
Table. 1. Constructed ConvNets
models
3.2 Trained ConvNets
features
!
Y6"
!
L:
!
l
i
:
!
H
0
6&
!
W67
!
b6$
P( | ;( , ))
i
l
0
Y(i) L H W b
3.3 General ConvNets features
" %*'
!
89:
!
(&
!
7&#;18<5=>-
**'
!
8?*'45<<<
!
*'=4=<<<
!
$0"*'
0
!
1+$@A;
!
4(5
!
#
3.4 Probability of Region
Consistency
A06
7
B6
Fig. 3. The relationship
between PRC and the threshold
to UCM.
log( )PRC threshold
45
48
3.5 Region Consistency Activation
"6
"4)C
6
( )
( ( ))
i
i
i
sum i
Y
P
Y
4=
( , ) ( , ) ( )Y i j Y i j PRC P j
4?
*13
!
'
A0
!
"1
4B8
!
4B
=
!
&
4B?
4. Experiments
Fig. 4. From row 1 to row 4 are original images, ground truth labels,
results based on the general ConvNets features and results based on
ConvNets features plus RCA. Column (a) to (e) are /ve scene labelling
examples from the Stanford Background dataset. Image (e) is an
example which illustrates that RCA may lead to a lower scene labelling
accuracy without the support from accurately classi/ed pixels (it
however achieved better visual consistency).
4.1 Examples on Stanford Background dataset
4.2 Results on Stanford Background and SIFT
Flow datasets
Table. 2. State-of-the-art
methods on Stanford
Background dataset
Table. 3. State-of-the-art
methods on SIFT Flow dataset
5. Conclusions
2-
+
13D
最新资源