rssLink RSS for all categories
 
icon_red
icon_green
icon_red
icon_red
icon_red
icon_green
icon_green
icon_red
icon_red
icon_red
icon_orange
icon_green
icon_green
icon_green
icon_red
icon_blue
icon_red
icon_orange
icon_red
icon_red
icon_red
icon_red
icon_red
icon_red
icon_red
icon_green
icon_red
icon_orange
icon_green
 

FS#420 — FS#4490 — route reflector IPv4

Attached to Project— Network
Maintenance
the whole network
CLOSED
100%
We will simplify the configurations on the
network by setting 3 routers reflectors
that will take and centralize all the BGP
announcements of all backbone routers,
recalculate the best route and then redistribute
the BGP table on all routers.

We should gain in BGP performance and in reliability
on the optic fibre cuts.
Date:  Saturday, 25 September 2010, 18:41PM
Reason for closing:  Done
Comment by OVH - Monday, 23 August 2010, 19:37PM

We should receive the 3 ASR 1000 by the end of August.

In the meanntime, we test this functionnality on the nexus 7000.


Comment by OVH - Monday, 23 August 2010, 19:44PM

The Nexus 7000 does not allows to do it.

It has only 256 Mb of RAM in one context and cannot take several
BGP full route sessions to recalculate them. It crashes.


Comment by OVH - Monday, 23 August 2010, 19:55PM

2010 Aug 19 20:08:43 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 5 Up
2010 Aug 19 20:11:15 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 2 Up
2010 Aug 19 20:11:41 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 4 Up
2010 Aug 19 20:12:58 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 6 Up
2010 Aug 19 20:13:32 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 6 Up
2010 Aug 19 20:14:17 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 8 Up
2010 Aug 19 20:15:23 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 7 Up
2010 Aug 19 20:17:18 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 0 Up
2010 Aug 19 20:18:01 rbx-97-n7-routing %BGP-3-ATTRID_OP: bgp-16276
[7084] Failed to find attribute ID
2010 Aug 19 20:18:01 rbx-97-n7-routing %BGP-3-NOMEMORY: bgp-16276
[7084] Could not allocate Attr entry, attr id
2010 Aug 19 20:18:01 rbx-97-n7-routing %BGP-2-PEERSHALTED: bgp-16276
[7084] BGP all internal peers shutdown due to no memory condition
(Error in sof
t reconfig processing of prefix)
2010 Aug 19 20:18:01 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 4 Down - out of resource error
2010 Aug 19 20:18:01 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 6 Down - out of resource error
2010 Aug 19 20:18:01 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 6 Down - out of resource error
2010 Aug 19 20:18:01 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 7 Down - out of resource error
2010 Aug 19 20:18:01 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 10 Down - out of resource error
2010 Aug 19 20:18:01 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 35 Down - out of resource error
2010 Aug 19 20:18:01 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 92 Down - out of resource error
2010 Aug 19 20:18:01 rbx-97-n7-routing %BGP-5-ADJCHANGE: bgp-16276
[7084] (default) neighbor 98 Down - out of resource error

# sh proc mem shared | i "urib "
Component Shared Memory Size Used
Available Ref
Address (kbytes) (kbytes)
(kbytes) Count
urib 0X52DD0000 256000* 21974
234026 16

Only 256Mb of RAM. With the licence that unbinds the
XL functionnalities

Feature Ins Lic Status Expiry Date Comments
Count
--------------------------------------------------------------------------------
SCALABLE_SERVICES_PKG Yes - In use Never -
TRANSPORT_SERVICES_PKG No - Unused -
LAN_ADVANCED_SERVICES_PKG Yes - In use Never -
LAN_ENTERPRISE_SERVICES_PKG Yes - In use Never -
--------------------------------------------------------------------------------

and the context to the max :

limit-resource u4route-mem minimum 250 maximum 250

rbx-97-n7# conf t
Enter configuration commands, one per line. End with CNTL/Z.
rbx-97-n7(config)# vdc routing id 2
rbx-97-n7(config-vdc)# limit-resource u4route-mem minimum ?
<1-250> Minimum route memory value

rbx-97-n7(config-vdc)# limit-resource u4route-mem minimum 250 maximum
?
<1-250> Maximum route memory value

rbx-97-n7(config-vdc)# limit-resource u4route-mem minimum 250 maximum
^C
rbx-97-n7(config-vdc)#

Only 256 Mb of RAM possible to take all the routes.
That's not what the cisco.com site says (2Gb of
RAM on the XL card and 4Gb on the sup ) but well ... Marketing.

So the conclusion is simple : Nexus 7000 is not usable at OVH.


Comment by OVH - Monday, 23 August 2010, 20:03PM

We took a good old 6509 in BXL and we succeeded to mount
all the BGP sessions of all the routers.

It's due to the limit of the available memory : 1 Gb

rf-1-6k#sh mem stat
Head Total(b) Used(b) Free(b) Lowest(b)
Largest(b)
Processor 468A6CD0 896865072 850757364 46107708 9822828
10606192
I/O 8000000 67108864 21991872 45116992 44793952
44512252

We need 850Mb to take all peer informations. 46 Mb are left :)

The router does only that. We are waiting for the ASR 1000

1 4 16276 4876914 117339 30402640 23 0 14:12:37
349852
2 4 16276 16905742 117333 30402640 0 0 14:06:13
431448
3 4 16276 18926841 117333 30402640 68 0 14:06:55
432619
4 4 16276 9158 140329 30402640 0 0 14:21:59
21415
6 4 16276 4694 140309 30402640 0 0 14:21:37
13029
8 4 16276 58 139558 30402640 0 0 00:55:08
3
1 4 16276 24580 116550 30402640 0 0 00:45:29
90369
3 4 16276 16063720 117316 30402640 0 0 13:49:16
432643
4 4 16276 4607205 117315 30402640 31 0 13:48:20
431427
5 4 16276 446715 117340 30402640 0 0 14:13:59
432622
6 4 16276 9738 140281 30402640 0 0 14:23:32
14880
7 4 16276 1320 119767 30402640 0 0 14:19:55
1285
8 4 16276 7998676 117334 30402640 0 0 14:07:23
432647
9 4 16276 6852706 117340 30402640 58 0 14:13:30
432622
0 4 16276 374696 117345 30402640 1 0 14:19:01
432622
1 4 16276 6332102 117315 30402640 29 0 13:48:46
423315
0 4 16276 21704 116549 30402640 0 0 00:44:18
97863
1 4 16276 16261554 117335 30402640 57 0 14:08:12
432621
4 4 16276 12933397 117314 30402640 0 0 13:47:49
430017
5 4 16276 5040207 117354 30402640 16 0 14:27:05
432612
2 4 16276 4328253 117361 30402734 10 0 14:24:32
432603
3 4 16276 16765697 117344 30402734 73 0 14:07:43
432621
4 4 16276 444294 117351 30402734 0 0 14:14:32
432626
5 4 16276 17336635 117324 30402734 11 0 13:47:09
431202
6 4 16276 18485 116558 30402734 0 0 00:44:05
90377
7 4 16276 20318 116557 30402734 0 0 00:43:56
0
8 4 16276 6001 140301 30402734 0 0 14:20:48
7499

oh yeah ! :)

rf-1-6k#sh ip route summary
IP routing table name is Default-IP-Routing-Table(0)
IP routing table maximum-paths is 32
Route Source Networks Subnets Overhead Memory (bytes)
connected 0 2 144 288
static 0 0 0 0
ospf 16276 13 239 36144 38332
Intra-area: 245 Inter-area: 6 External-1: 1 External-2: 0
NSSA External-1: 0 NSSA External-2: 0
bgp 16276 138410 294176 31146192 62368012
External: 0 Internal: 432586 Local: 0
internal 5489 12009932
Total 143912 294417 31182480 74416564
Removing Queue Size 0


Comment by OVH - Monday, 23 August 2010, 21:16PM

We will put the configuration on vie-1-6k


Comment by OVH - Monday, 23 August 2010, 21:22PM

VIX works on 193.203.0.0/24 which is a private network.
For an unknow reason VIX announces this network on Internet.
The trafic was redirected. We have filtered the announcements
in order to avoid having 193.203.0.0/24 in the BGP


Comment by OVH - Monday, 23 August 2010, 21:22PM

We will add pra-1-6k in the collector


Comment by OVH - Monday, 23 August 2010, 21:24PM

No problem.

We change to var-1-6k


Comment by OVH - Monday, 23 August 2010, 21:25PM

No problem.

We change to mil-1-6k


Comment by OVH - Monday, 23 August 2010, 21:25PM

No problem

We change to zur-1-6k


Comment by OVH - Monday, 23 August 2010, 21:26PM

TIX announces also 194.42.48.0/24 in public.
We will contact it too.


Comment by OVH - Monday, 23 August 2010, 21:27PM

lyo-1-6k done
we change to mar-1-6k


Comment by OVH - Monday, 23 August 2010, 21:30PM

mar-1-6k done
mad-1-6k done

That's all for today. We will check if everything
is working.

rf-1-6k#sh mem stat
Head Total(b) Used(b) Free(b) Lowest(b)
Largest(b)
Processor 468A6CD0 896865072 846133672 50731400 9822828
10606192
I/O 8000000 67108864 21958860 45150004 43552040
44200284


50Mb free. We progress in the simplifying of the BGP :)


Comment by OVH - Wednesday, 25 August 2010, 10:11AM

We have received the ASR 1000.

rf-2-a1#sh mem stat
Head Total(b) Used(b) Free(b) Lowest(b) Largest(b)
Processor 2C085008 1821505244 160192080 1661313164 1660142120 1658947932
lsmpi_io 98BE21D0 6295088 6294120 968 968 968

2Go de RAM ... !?

http://www.cisco.com/en/US/products/ps9343/prod_models_comparison.html

We have said 4Go !? WTF ???


Comment by OVH - Wednesday, 25 August 2010, 10:12AM

We have implemented RF-2-a1. The sessions are being
mounted with all the backbone routers.


Comment by OVH - Wednesday, 25 August 2010, 10:12AM

Aug 24 21:53:44 UTC: %PLATFORM-4-ELEMENT_WARNING: R0/0: smand: ESP/0: Committed Memory value 311% exceeds warning level 310%


Comment by OVH - Wednesday, 25 August 2010, 10:14AM

RF-1 configuration and RF2 are the same.

Now we can continue the development of the route reflector
from tomorrow on the more complicated routers in terms of
configuration. A lot of things to check.


Comment by OVH - Thursday, 26 August 2010, 13:24PM

We switch to p19-52.


Comment by OVH - Thursday, 26 August 2010, 13:26PM

done
P19-57
done
p19-2


Comment by OVH - Thursday, 26 August 2010, 13:30PM

p19-7


Comment by OVH - Thursday, 26 August 2010, 15:21PM

ams-1-6k

crash


Comment by OVH - Thursday, 26 August 2010, 15:22PM

ldn-1-6k#sh mem stat
Head Total(b) Used(b) Free(b) Lowest(b) Largest(b)
Processor 44B199D0 927852080 879716120 48135960 33992048 26522704
I/O 8000000 67108864 11968016 55140848 50129760 54998488


Comment by OVH - Thursday, 26 August 2010, 15:22PM

Aug 26 15:03:41 20G.ldn-1-6k.routers.ovh.net 73683: Aug 26 14:03:17 GMT: %FIB-3-NOMEM: Malloc Failure, disabling DCEF


Comment by OVH - Tuesday, 07 September 2010, 09:22AM

We start fra-5. 175Mb of available RAM.


Comment by OVH - Tuesday, 07 September 2010, 09:23AM

done.

bru-1
done


Comment by OVH - Tuesday, 07 September 2010, 09:26AM

We are going to change the rf-1 on the new hardware.


Comment by OVH - Tuesday, 07 September 2010, 09:26AM

We are setting the third rf.


Comment by OVH - Tuesday, 07 September 2010, 09:27AM

All m1/m2 are in the 3 routes reflectors.


Comment by OVH - Tuesday, 07 September 2010, 09:28AM

We continue with the th1.


Comment by OVH - Tuesday, 07 September 2010, 09:28AM

done.

th2


Comment by OVH - Tuesday, 07 September 2010, 09:30AM

th2 done
gsw-1 done
gsw-2 done
rbx-1 done
rbx-2 done


Comment by OVH - Tuesday, 07 September 2010, 09:36AM

We are going to cut the the m1/m2 router announcements from roubaix1 to rbx-1.
The three route refelctors will retake the announcements.


Comment by OVH - Tuesday, 07 September 2010, 11:24AM

We have finished the working for the changes
to the route refelectors of ip failover p19 ,roubaix1
and dc1/gsw at the level of the housing.

http://status.ovh.net/?do=details&id=502
http://status.ovh.net/?do=details&id=503
http://status.ovh.net/?do=details&id=501


Comment by OVH - Tuesday, 07 September 2010, 11:27AM

Right now , all the backbone runs in the
"route reflector" configuration.

Still to be done :

-The BGP rewriting to OPSF at the level of certain interfaces.
- put IPv6 on the "route reflector" configuration.


Comment by OVH - Thursday, 09 September 2010, 10:09AM

We will insert the OSPF routes in the network.


Comment by OVH - Thursday, 09 September 2010, 10:10AM

done.

We will remove the same routes from BGP.


Comment by OVH - Thursday, 09 September 2010, 10:11AM

vss-2 done.


Comment by OVH - Thursday, 09 September 2010, 10:11AM

vss-1 done.


Comment by OVH - Thursday, 09 September 2010, 10:19AM

vss-3 done.


Comment by OVH - Thursday, 09 September 2010, 10:19AM

rbx-99 cloud computing


Comment by OVH - Thursday, 09 September 2010, 10:19AM

done


Comment by OVH - Sunday, 19 September 2010, 21:49PM

Work on the reflector IPv4 was completed.
We will start work on IPv6.


Comment by OVH - Wednesday, 22 September 2010, 01:43AM

We are cleaning all useless BGP sessions.


Comment by OVH - Wednesday, 22 September 2010, 01:43AM

Done.


Comment by OVH - Saturday, 25 September 2010, 18:40PM

We have always the same error messages on the 3 route collectors :

Sep 25 13:51:50 UTC: %PLATFORM-3-ELEMENT_CRITICAL: R0/0: smand:
ESP/0: Committed Memory value 323% exceeds critical level 320%
Sep 25 14:02:00 UTC: %PLATFORM-3-ELEMENT_CRITICAL: R0/0: smand:
ESP/0: Committed Memory value 323% exceeds critical level 320%
Sep 25 14:12:10 UTC: %PLATFORM-3-ELEMENT_CRITICAL: R0/0: smand:
ESP/0: Committed Memory value 323% exceeds critical level 320%
Sep 25 14:22:20 UTC: %PLATFORM-3-ELEMENT_CRITICAL: R0/0: smand:
ESP/0: Committed Memory value 323% exceeds critical level 320%
Sep 25 14:32:30 UTC: %PLATFORM-3-ELEMENT_CRITICAL: R0/0: smand:
ESP/0: Committed Memory value 323% exceeds critical level 320%
Sep 25 14:42:40 UTC: %PLATFORM-3-ELEMENT_CRITICAL: R0/0: smand:
ESP/0: Committed Memory value 323% exceeds critical level 320%
Sep 25 14:52:50 UTC: %PLATFORM-3-ELEMENT_CRITICAL: R0/0: smand:
ESP/0: Committed Memory value 323% exceeds critical level 320%
Sep 25 15:03:00 UTC: %PLATFORM-3-ELEMENT_CRITICAL: R0/0: smand:
ESP/0: Committed Memory value 323% exceeds critical level 320%
Sep 25 15:13:10 UTC: %PLATFORM-3-ELEMENT_CRITICAL: R0/0: smand:
ESP/0: Committed Memory value 323% exceeds critical level 320%

It may be a bug listed by cisco CSCtd83822

CSCtd83822

Increasing memory usage of `reflector.sh' and `droputil.sh' process
may occur on the ASR 1000 Router Series.

Workaround: None

https://supportforums.cisco.com/thread/2040810?decorator=print&displayFullThread=true
http://www.cisco.com/en/US/docs/ios/ios_xe/2/release/notes/rnasr21.html