Too many 404 pages Upset me
Posted: Thu Aug 30, 2018 8:31 pm
I have a doubt, the 404 pages so more,
I solved it by robots file, I want to ask if this is correct.
if it will have a effect to crawl the normal page
as like ,i have seen a effect in my sitemap,but i dont sure
This the robots file :
User-agent: *
Allow: /
Disallow: /Themes/StyleJotrin/js/
Disallow: /Themes/StyleJotrin/Images/
Disallow: /Themes/StyleJotrin/navigation/
Disallow: /technology/details/hall_effect_sensor_ic_offers_a_response_time_of_just_3%CE%BCs
Disallow: /manufacturer/details/W_W
Disallow: /manufacturer/details/UNITY_MICROELECTRONICS
Disallow: /manufacturer/details/VIDCO
Disallow: /manufacturer/details/UNISOURCE
Disallow: /manufacturer/details/AT
Disallow: /manufacturer/details/DSI
Disallow: /manufacturer/details/KEY
Disallow: /manufacturer/details/CVILUX
Disallow: /manufacturer/details/3TRONICS_TECHNICAL_SERVICES
Disallow: /manufacturer/details/MTRONIND
Disallow: /manufacturer/details/HAS
Disallow: /manufacturer/details/ARIMA
Disallow: /manufacturer/details/DLV
Disallow: /manufacturer/details/FRS
Disallow: /manufacturer/details/GT
Disallow: /manufacturer/details/SOLID
Disallow: /manufacturer/details/APN
Disallow: /manufacturer/details/KYOCERA%20KINSEKI
Disallow: /manufacturer/details/NCS
Disallow: /manufacturer/details/FWISTEF
Disallow: /manufacturer/details/GEN
Disallow: /manufacturer/details/CI
Disallow: /manufacturer/details/AUOOPTRO
Disallow: /manufacturer/details/HJC
Disallow: /manufacturer/details/GW-MG
Disallow: /manufacturer/details/PT
Disallow: /manufacturer/details/AGI
Disallow: /manufacturer/details/H1656-39
Disallow: /manufacturer/details/OB
Disallow: /manufacturer/details/EDGE
Disallow: /manufacturer/details/LELON%20ELECTRONIC
Disallow: /manufacturer/details/ANY
Disallow: /manufacturer/details/PACK
Disallow: /manufacturer/details/GPX
Disallow: /manufacturer/details/EICI
Disallow: /manufacturer/details/CIRRUS
Disallow: /manufacturer/details/EST
Disallow: /manufacturer/details/REL
Disallow: /manufacturer/details/ROASSOCIATES
Disallow: /product/cate/174
Disallow: /manufacturer/details/MAINPOWER
Disallow: /manufacturer/details/AELCRYSL
Disallow: /manufacturer/details/CAT
Disallow: /manufacturer/details/PM
Disallow: /manufacturer/details/MR
Disallow: /manufacturer/details/MIC
Disallow: /manufacturer/details/MARQUARDTSWITCHES
Disallow: /manufacturer/details/SC
Disallow: /manufacturer/details/CZJI
Disallow: /manufacturer/details/JRM
Disallow: /manufacturer/details/CAMRX
Disallow: /manufacturer/details/HGF
Disallow: /manufacturer/details/BOCHEN
Disallow: /manufacturer/details/DEI
Disallow: /manufacturer/details/JEC
Disallow: /manufacturer/details/ROSH
Disallow: /manufacturer/details/LILONG
Disallow: /manufacturer/details/USI
Disallow: /manufacturer/details/RAY
Disallow: /manufacturer/details/POWER(PI)
Disallow: /manufacturer/details/DIGITAL%20DATA%20COMMUNICATIONS%20GMBH
Disallow: /manufacturer/details/CCT
Disallow: /manufacturer/details/VSF
Disallow: /manufacturer/details/INT
Disallow: /manufacturer/details/JUNS
Disallow: /manufacturer/details/CHK
Disallow: /manufacturer/details/GD
Disallow: /manufacturer/details/ATRICA
Disallow: /manufacturer/details/CCA
Disallow: /manufacturer/details/AIT
Disallow: /manufacturer/details/MU
Disallow: /manufacturer/details/COMPOSTAR
Disallow: /manufacturer/details/SIE
Disallow: /manufacturer/details/DIP16
Disallow: /manufacturer/details/HML
Disallow: /manufacturer/details/GIT
Disallow: /manufacturer/details/ESI
Disallow: /manufacturer/details/PARDUIT
Disallow: /manufacturer/details/ADR
Disallow: /manufacturer/details/ENE
Disallow: /manufacturer/details/MLG
Disallow: /manufacturer/details/COMMSCOPE
Disallow: /manufacturer/details/EVER
Disallow: /manufacturer/details/2B
Disallow: /manufacturer/details/NIP
Disallow: /manufacturer/details/HUAJING
Disallow: /manufacturer/details/IPS
Disallow: /manufacturer/details/FL
Disallow: /manufacturer/details/MIT
Disallow: /manufacturer/details/NSN
Disallow: /manufacturer/details/FUJIELECTRIC
Disallow: /manufacturer/details/SSN
Disallow: /manufacturer/details/MAT
Disallow: /manufacturer/details/GENNUM
Disallow: /manufacturer/details/AN
Disallow: /manufacturer/details/SAPS
Disallow: /manufacturer/details/OML
Disallow: /manufacturer/details/LSPS
Disallow: /manufacturer/details/DIGITAL%20VIEW
Disallow: /manufacturer/details/HSMC
Disallow: /manufacturer/details/TKD
Disallow: /manufacturer/details/HYEOPJIN
Disallow: /manufacturer/details/ANAM
Disallow: /manufacturer/details/SKN
Disallow: /manufacturer/details/INPQA
Disallow: /manufacturer/details/JAT
Disallow: /manufacturer/details/SILICONLABS
Disallow: /manufacturer/details/LSD
Disallow: /manufacturer/details/HYS
Disallow: /manufacturer/details/TE
Disallow: /manufacturer/details/KUAN%20HSI
Disallow: /manufacturer/details/ESC
Disallow: /manufacturer/details/SMG
Disallow: /manufacturer/details/TMS
Disallow: /manufacturer/details/SKA
Disallow: /manufacturer/details/MICROCIP
Disallow: /manufacturer/details/RX3
Disallow: /manufacturer/details/KED
Disallow: /manufacturer/details/KEN-TOP
Disallow: /manufacturer/details/KIA
Disallow: /manufacturer/details/WTJ
Disallow: /manufacturer/details/SANISK
Disallow: /manufacturer/details/SRC
Disallow: /manufacturer/details/KBR
Disallow: /manufacturer/details/TSV
Disallow: /manufacturer/details/MT
Disallow: /manufacturer/details/VR
Disallow: /manufacturer/details/ZZB
Disallow: /manufacturer/details/EMP
Disallow: /manufacturer/details/AIPRAX
Disallow: /product/parts/9801537
Disallow: /manufacturer/details/IL
Disallow: /manufacturer/details/KDS
Disallow: /product/parts/100319396
Disallow: /manufacturer/details/FREESCAL
Disallow: /manufacturer/details/HSL
Disallow: /product/parts/6920
Disallow: /manufacturer/details/ALLEN-BRADLEY
Disallow: /manufacturer/details/JOINSET
Disallow: /manufacturer/details/FXXC
Disallow: /manufacturer/details/CREATIVE
Disallow: /manufacturer/details/DAEBO
Disallow: /manufacturer/details/ADM
Disallow: /manufacturer/details/0B
Disallow: /manufacturer/details/AUKCORP
Disallow: /manufacturer/details/CHMCSTON
Disallow: /manufacturer/details/STY
Disallow: /manufacturer/details/CRYSTRL
Disallow: /manufacturer/details/PART
Disallow: /manufacturer/details/RENASASS
Disallow: /manufacturer/details/THE
Disallow: /manufacturer/details/SP
Disallow: /manufacturer/details/HKE
Disallow: /manufacturer/details/LL
Disallow: /manufacturer/details/SOD
Disallow: /manufacturer/details/CAPELLA
Disallow: /manufacturer/details/ALPHA&OMEGA
Disallow: /manufacturer/details/CR
Disallow: /manufacturer/details/SEN
Disallow: /manufacturer/details/AMI%20SEMICONDUCTOR
Disallow: /manufacturer/details/SNY
Disallow: /manufacturer/details/JF
Disallow: /manufacturer/details/CORERIVER
Disallow: /manufacturer/details/KEM
Disallow: /manufacturer/details/SL
Disallow: /manufacturer/details/LE
Disallow: /manufacturer/details/SNK
Disallow: /manufacturer/details/TW
Disallow: /manufacturer/details/LTK
Disallow: /manufacturer/details/SID
Disallow: /manufacturer/details/EVOX%20RIFA
Disallow: /manufacturer/details/COL
Disallow: /manufacturer/details/GIGADEVIC
Disallow: /manufacturer/details/TEC
Disallow: /manufacturer/details/HA
Disallow: /manufacturer/details/COSIN
Disallow: /manufacturer/details/CYNTE
Disallow: /manufacturer/details/COTCO
Disallow: /manufacturer/details/3U
Disallow: /manufacturer/details/CCE
Disallow: /manufacturer/details/3COM
Disallow: /manufacturer/details/LSILOGI
Disallow: /manufacturer/details/CHIPOEN
Disallow: /manufacturer/details/WACOM
Disallow: /manufacturer/details/SIX
Disallow: /manufacturer/details/PMI
Disallow: /manufacturer/details/SIW
Disallow: /manufacturer/details/OK%20INDUSTRIES
Disallow: /manufacturer/details/ASTRON
Disallow: /manufacturer/details/PSI
Disallow: /manufacturer/details/DAYI-ELEC
Disallow: /manufacturer/details/EVERLIGH
Disallow: /manufacturer/details/RTL
Disallow: /manufacturer/details/AUSTRIAMICROSYSTEMS%20AG
Disallow: /manufacturer/details/EAST
Disallow: /manufacturer/details/A1SEMI
Disallow: /manufacturer/details/IFM
Disallow: /manufacturer/details/MARK
Disallow: /manufacturer/details/AUTOLIV
Disallow: /manufacturer/details/TR
Disallow: /manufacturer/details/ADA
Disallow: /manufacturer/details/SICG
Disallow: /manufacturer/details/SMP
Disallow: /manufacturer/details/EMCT
Disallow: /manufacturer/details/CN
Disallow: /product/parts/100215369
Disallow: /manufacturer/details/BZD
Disallow: /manufacturer/details/ALCO
Disallow: /manufacturer/details/UCA
Disallow: /manufacturer/details/PI
Disallow: /manufacturer/details/MEGAWIN
Disallow: /manufacturer/details/PULS
Disallow: /manufacturer/details/HOSHIDEN
Disallow: /manufacturer/details/ELED
Disallow: /manufacturer/details/BAIRONG
Disallow: /manufacturer/details/EXCEL
Disallow: /manufacturer/details/MOSTYLE
Disallow: /manufacturer/details/ISA
Disallow: /manufacturer/details/CONTINENTAL%20INDUSTRIES
Disallow: /manufacturer/details/JNS-DZ
Disallow: /manufacturer/details/BELSTEWART
Disallow: /manufacturer/details/MOTO
Disallow: /manufacturer/details/DATE
Disallow: /manufacturer/details/PU
Disallow: /manufacturer/details/AMICA
Disallow: /manufacturer/details/MFG
Disallow: /manufacturer/details/VNCR
Disallow: /manufacturer/details/NU
Disallow: /manufacturer/details/WST
Disallow: /product/parts/410103
Disallow: /manufacturer/details/GH
Disallow: /manufacturer/details/PQI
Disallow: /manufacturer/details/WON
Disallow: /manufacturer/details/LST
Disallow: /product/parts/21851
Disallow: /manufacturer/details/GREEN
Disallow: /manufacturer/details/SUN
Disallow: /manufacturer/details/LGE
Disallow: /manufacturer/details/LINFINIT
Disallow: /manufacturer/details/UK
Disallow: /manufacturer/details/EIPIDA
Disallow: /manufacturer/details/HOL
Disallow: /manufacturer/details/SFT
Disallow: /manufacturer/details/HGHKE
Disallow: /product/cate/151
Disallow: /manufacturer/details/LS
Disallow: /manufacturer/details/ROHMPB
Disallow: /manufacturer/details/PANGSONIC
Disallow: /manufacturer/details/AEC
Disallow: /manufacturer/details/JUNYE
Disallow: /manufacturer/details/ACF
Disallow: /manufacturer/details/CHAHUA
Disallow: /manufacturer/details/VLI
Disallow: /manufacturer/details/ROCKCHIP
Disallow: /manufacturer/details/E-TEC
Disallow: /manufacturer/details/EB
Disallow: /manufacturer/details/BUS
Disallow: /manufacturer/details/ICC
Disallow: /manufacturer/details/MCH
Disallow: /manufacturer/details/MTT
Disallow: /manufacturer/details/PFS
Disallow: /manufacturer/details/RTH
Disallow: /manufacturer/details/NIS
Disallow: /manufacturer/details/NSF
Disallow: /manufacturer/details/K&L
Disallow: /manufacturer/details/ETI
Disallow: /manufacturer/details/MW
Disallow: /manufacturer/details/-
Disallow: /manufacturer/details/IARA
Disallow: /manufacturer/details/AKW
Disallow: /manufacturer/details/AZ
Disallow: /manufacturer/details/SDC
Disallow: /manufacturer/details/LEDDYNAMICS
Disallow: /manufacturer/details/BAI%20HONG
Disallow: /manufacturer/details/PA
Disallow: /manufacturer/details/ANTELEC
Disallow: /manufacturer/details/AGT
Disallow: /manufacturer/details/PER
Disallow: /manufacturer/details/LIS
Disallow: /product/mfg/TAKAMIZAWA
Disallow: /manufacturer/details/IPI
Disallow: /manufacturer/details/LM
Disallow: /manufacturer/details/AOLSZ
Disallow: /manufacturer/details/HII
Disallow: /manufacturer/details/HAM
Disallow: /manufacturer/details/ETC1
Disallow: /manufacturer/details/FORTECH
Disallow: /manufacturer/details/APW
Disallow: /manufacturer/details/ITF
Disallow: /manufacturer/details/B1
Disallow: /manufacturer/details/NIAS
Disallow: /manufacturer/details/DW
Disallow: /manufacturer/details/EW
Disallow: /manufacturer/details/SCANDISK
Disallow: /manufacturer/details/RSMTECH
Disallow: /manufacturer/details/FS
Disallow: /manufacturer/details/ITW-CHEM
Disallow: /manufacturer/details/ACER
Disallow: /manufacturer/details/KING
Disallow: /manufacturer/details/GPL
Disallow: /manufacturer/details/AZUREWAVE
Disallow: /manufacturer/details/CONWISE
Disallow: /manufacturer/details/XCV
Disallow: /manufacturer/details/REI
Disallow: /manufacturer/details/MSM
Disallow: /manufacturer/details/AVC
Disallow: /manufacturer/details/CXA
Disallow: /manufacturer/details/FPS
Disallow: /manufacturer/details/ULN
Disallow: /manufacturer/details/BYD
Disallow: /manufacturer/details/KFX
Disallow: /manufacturer/details/PLCC44
Disallow: /manufacturer/details/NORITAKE%20ITRON%20VFD
Disallow: /manufacturer/details/ECE
Disallow: /manufacturer/details/RAFI
Disallow: /manufacturer/details/MARKTECH
Disallow: /manufacturer/details/KAM
Disallow: /manufacturer/details/TLP
Disallow: /manufacturer/details/GTK
Disallow: /manufacturer/details/MOTOIOLA
Disallow: /manufacturer/details/ITTCANNON
Disallow: /manufacturer/details/DTBCOM
Disallow: /manufacturer/details/HC
Disallow: /manufacturer/details/KTC
Disallow: /manufacturer/details/DANIEL_WOODHEAD
Disallow: /manufacturer/details/DHC
Disallow: /manufacturer/details/FRAMATOME
Disallow: /manufacturer/details/TMT
Disallow: /manufacturer/details/RT
Disallow: /manufacturer/details/AMER
Disallow: /manufacturer/details/DFX
Disallow: /manufacturer/details/IPD
Disallow: /manufacturer/details/BUD
Disallow: /manufacturer/details/PLTS
Disallow: /manufacturer/details/GMT1F
Disallow: /manufacturer/details/SMS
Disallow: /manufacturer/details/LH
Disallow: /manufacturer/details/KAISE
Disallow: /manufacturer/details/HONHAI
Disallow: /manufacturer/details/REC
Disallow: /manufacturer/details/JHN
Disallow: /manufacturer/details/CMI
Disallow: /manufacturer/details/INE
Disallow: /manufacturer/details/MSV
Disallow: /manufacturer/details/ATF
Disallow: /manufacturer/details/TEKNDVUS
Disallow: /manufacturer/details/S+M
Disallow: /manufacturer/details/TA-I%20TECH
Disallow: /manufacturer/details/CSC
Disallow: /manufacturer/details/ELC
Disallow: /manufacturer/details/RTD
Disallow: /manufacturer/details/JXB
Disallow: /manufacturer/details/POWERSEM
Disallow: /manufacturer/details/KMP
Disallow: /manufacturer/details/CDS
Disallow: /manufacturer/details/EPX%20MICROWAVE
Disallow: /manufacturer/details/HST
Disallow: /manufacturer/details/ALTREA
Disallow: /manufacturer/details/KRS
Disallow: /manufacturer/details/CROUP-TEK
Disallow: /manufacturer/details/GROUP-T
Disallow: /manufacturer/details/JINHAI
Disallow: /manufacturer/details/VTM
Disallow: /manufacturer/details/GROUP-TECK
Disallow: /manufacturer/details/HEL
Disallow: /manufacturer/details/LGPHILIPSLCD
Disallow: /manufacturer/details/EPIGAP
Disallow: /manufacturer/details/ITA
Disallow: /manufacturer/details/YAMA
Disallow: /manufacturer/details/NEDI
Disallow: /manufacturer/details/APR
Disallow: /manufacturer/details/JLWORLD
Disallow: /manufacturer/details/GLIOXIN
Disallow: /manufacturer/details/GIGA%20DEVICE
Disallow: /manufacturer/details/DORDIC
Disallow: /manufacturer/details/TDTAIKO
Disallow: /manufacturer/details/HF
Disallow: /manufacturer/details/FGX
Disallow: /manufacturer/details/DESTINY
Disallow: /manufacturer/details/PRODIGIT
Disallow: /manufacturer/details/CHANG%20SUNG%20(H)
Disallow: /manufacturer/details/ICT
Disallow: /manufacturer/details/ETEK
Disallow: /manufacturer/details/INR
Disallow: /manufacturer/details/INTER
Disallow: /manufacturer/details/FUJIKURA
Disallow: /product/parts/65126907
Disallow: /manufacturer/details/BLCH
Disallow: /manufacturer/details/SLE
Disallow: /manufacturer/details/PTR
Disallow: /manufacturer/details/CONNOR%20WINFIELD
Disallow: /manufacturer/details/HOTCHIP
Disallow: /manufacturer/details/KET
Disallow: /manufacturer/details/HEDS
Disallow: /manufacturer/details/PMM
Disallow: /manufacturer/details/PACCOM
Disallow: /manufacturer/details/AUK%20LED
Disallow: /manufacturer/details/FDK%20BATTERIES%20(FORMERLY%20SANYO)
Disallow: /manufacturer/details/SAMW
Disallow: /manufacturer/details/PAN%20JIT
Disallow: /manufacturer/details/TMI
Disallow: /manufacturer/details/EBCHQ
Disallow: /manufacturer/details/CIR
Disallow: /manufacturer/details/A04402
Disallow: /manufacturer/details/HNS
Disallow: /manufacturer/details/DBLE
Disallow: /manufacturer/details/SANSUMG
Disallow: /manufacturer/details/OTI
Disallow: /manufacturer/details/FUJ
Disallow: /manufacturer/details/CE
Disallow: /manufacturer/details/DVE
Disallow: /manufacturer/details/HI
Disallow: /manufacturer/details/MST
Disallow: /manufacturer/details/HASC
Disallow: /manufacturer/details/STI
Disallow: /manufacturer/details/3L
Disallow: /manufacturer/details/DIODE%20LASER%20CONCEPTS
Disallow: /manufacturer/details/NETD
Disallow: /manufacturer/details/BARRY
Disallow: /manufacturer/details/MHS
Disallow: /manufacturer/details/DALL
Disallow: /manufacturer/details/MMI
Disallow: /manufacturer/details/JDI
Disallow: /manufacturer/details/ECC
Disallow: /manufacturer/details/KYC
Disallow: /manufacturer/details/ABR
Disallow: /manufacturer/details/IMLSMI
Disallow: /manufacturer/details/SEGA
Disallow: /manufacturer/details/QX
Disallow: /manufacturer/details/ALC
Disallow: /manufacturer/details/CHIPGOAL
Disallow: /manufacturer/details/STM
Disallow: /manufacturer/details/NGK
Disallow: /manufacturer/details/KOKURIKU
Disallow: /manufacturer/details/HONHAIPRECISIONINDCOLTD
Disallow: /manufacturer/details/PHL
Disallow: /manufacturer/details/LTL
Disallow: /manufacturer/details/MAGDOTCOMM
Disallow: /manufacturer/details/SB
Disallow: /manufacturer/details/PUL
Disallow: /manufacturer/details/CJT
Disallow: /manufacturer/details/TARNGYU
Disallow: /manufacturer/details/EUPHONLK
Disallow: /manufacturer/details/DN
Disallow: /manufacturer/details/ESPON
Disallow: /manufacturer/details/ZHJ
Disallow: /manufacturer/details/TRC
Disallow: /manufacturer/details/AC%20SSR
Disallow: /manufacturer/details/KAE
Disallow: /manufacturer/details/WEITREND
Disallow: /manufacturer/details/CERATE
Disallow: /manufacturer/details/COPPERGA
Disallow: /manufacturer/details/MOSDESIG
Disallow: /manufacturer/details/ITE
Disallow: /manufacturer/details/4P
Disallow: /manufacturer/details/ATT
Disallow: /manufacturer/details/RHNXP%20SE
Disallow: /manufacturer/details/CEPAG
Disallow: /manufacturer/details/GST
Disallow: /manufacturer/details/RTS
Disallow: /manufacturer/details/SCHNEIDERELECTRIC
Disallow: /manufacturer/details/KGB
Disallow: /manufacturer/details/CORTROL
Disallow: /manufacturer/details/STN
Disallow: /manufacturer/details/BRIGHT%20L
Disallow: /manufacturer/details/CSG
Disallow: /manufacturer/details/LDB
Disallow: /manufacturer/details/MK
Disallow: /manufacturer/details/GY
Disallow: /manufacturer/details/LKY
Disallow: /manufacturer/details/FRD
Disallow: /manufacturer/details/BROO
Disallow: /manufacturer/details/E20
Disallow: /manufacturer/details/LUCIX
Disallow: /manufacturer/details/AGERES
Disallow: /manufacturer/details/ICD
Disallow: /manufacturer/details/BRI
Disallow: /manufacturer/details/AGER
Disallow: /manufacturer/details/SOLIDLITE
Disallow: /manufacturer/details/AX
Disallow: /manufacturer/details/BSE
Disallow: /manufacturer/details/ANDATEK
Disallow: /manufacturer/details/CAL
Disallow: /manufacturer/details/BIZLINK
Disallow: /manufacturer/details/EXCEL%20CELL%20ELECTRONIC
Disallow: /manufacturer/details/HEI
Disallow: /manufacturer/details/FUNJIN
Disallow: /manufacturer/details/NVC
Disallow: /manufacturer/details/ECL
Disallow: /manufacturer/details/HYL
Disallow: /manufacturer/details/PERIPHERAES
Disallow: /manufacturer/details/RHO
Disallow: /manufacturer/details/13+OZ
Disallow: /manufacturer/details/E2O
Disallow: /manufacturer/details/M-TEK
Disallow: /manufacturer/details/PTR%20CONNEX
Disallow: /manufacturer/details/RMC
Disallow: /manufacturer/details/TNY
Disallow: /manufacturer/details/SJ
Disallow: /manufacturer/details/SOP
Disallow: /manufacturer/details/DINTEK
Disallow: /manufacturer/details/CHIPSBANK
Disallow: /manufacturer/details/L_3
Disallow: /manufacturer/details/KH
Disallow: /manufacturer/details/HLI
Disallow: /manufacturer/details/DLOGIXS
Disallow: /manufacturer/details/EC
Disallow: /manufacturer/details/TAG
Disallow: /manufacturer/details/JALCO
Disallow: /manufacturer/details/COMEXAT
Disallow: /manufacturer/details/IRW
Disallow: /manufacturer/details/TLM
Disallow: /manufacturer/details/CHIPSHIN
Disallow: /manufacturer/details/NSR
Disallow: /manufacturer/details/KS
Disallow: /manufacturer/details/TKS
Disallow: /manufacturer/details/STAUBLL
Disallow: /manufacturer/details/MICROMETRICS
I solved it by robots file, I want to ask if this is correct.
if it will have a effect to crawl the normal page
as like ,i have seen a effect in my sitemap,but i dont sure
This the robots file :
User-agent: *
Allow: /
Disallow: /Themes/StyleJotrin/js/
Disallow: /Themes/StyleJotrin/Images/
Disallow: /Themes/StyleJotrin/navigation/
Disallow: /technology/details/hall_effect_sensor_ic_offers_a_response_time_of_just_3%CE%BCs
Disallow: /manufacturer/details/W_W
Disallow: /manufacturer/details/UNITY_MICROELECTRONICS
Disallow: /manufacturer/details/VIDCO
Disallow: /manufacturer/details/UNISOURCE
Disallow: /manufacturer/details/AT
Disallow: /manufacturer/details/DSI
Disallow: /manufacturer/details/KEY
Disallow: /manufacturer/details/CVILUX
Disallow: /manufacturer/details/3TRONICS_TECHNICAL_SERVICES
Disallow: /manufacturer/details/MTRONIND
Disallow: /manufacturer/details/HAS
Disallow: /manufacturer/details/ARIMA
Disallow: /manufacturer/details/DLV
Disallow: /manufacturer/details/FRS
Disallow: /manufacturer/details/GT
Disallow: /manufacturer/details/SOLID
Disallow: /manufacturer/details/APN
Disallow: /manufacturer/details/KYOCERA%20KINSEKI
Disallow: /manufacturer/details/NCS
Disallow: /manufacturer/details/FWISTEF
Disallow: /manufacturer/details/GEN
Disallow: /manufacturer/details/CI
Disallow: /manufacturer/details/AUOOPTRO
Disallow: /manufacturer/details/HJC
Disallow: /manufacturer/details/GW-MG
Disallow: /manufacturer/details/PT
Disallow: /manufacturer/details/AGI
Disallow: /manufacturer/details/H1656-39
Disallow: /manufacturer/details/OB
Disallow: /manufacturer/details/EDGE
Disallow: /manufacturer/details/LELON%20ELECTRONIC
Disallow: /manufacturer/details/ANY
Disallow: /manufacturer/details/PACK
Disallow: /manufacturer/details/GPX
Disallow: /manufacturer/details/EICI
Disallow: /manufacturer/details/CIRRUS
Disallow: /manufacturer/details/EST
Disallow: /manufacturer/details/REL
Disallow: /manufacturer/details/ROASSOCIATES
Disallow: /product/cate/174
Disallow: /manufacturer/details/MAINPOWER
Disallow: /manufacturer/details/AELCRYSL
Disallow: /manufacturer/details/CAT
Disallow: /manufacturer/details/PM
Disallow: /manufacturer/details/MR
Disallow: /manufacturer/details/MIC
Disallow: /manufacturer/details/MARQUARDTSWITCHES
Disallow: /manufacturer/details/SC
Disallow: /manufacturer/details/CZJI
Disallow: /manufacturer/details/JRM
Disallow: /manufacturer/details/CAMRX
Disallow: /manufacturer/details/HGF
Disallow: /manufacturer/details/BOCHEN
Disallow: /manufacturer/details/DEI
Disallow: /manufacturer/details/JEC
Disallow: /manufacturer/details/ROSH
Disallow: /manufacturer/details/LILONG
Disallow: /manufacturer/details/USI
Disallow: /manufacturer/details/RAY
Disallow: /manufacturer/details/POWER(PI)
Disallow: /manufacturer/details/DIGITAL%20DATA%20COMMUNICATIONS%20GMBH
Disallow: /manufacturer/details/CCT
Disallow: /manufacturer/details/VSF
Disallow: /manufacturer/details/INT
Disallow: /manufacturer/details/JUNS
Disallow: /manufacturer/details/CHK
Disallow: /manufacturer/details/GD
Disallow: /manufacturer/details/ATRICA
Disallow: /manufacturer/details/CCA
Disallow: /manufacturer/details/AIT
Disallow: /manufacturer/details/MU
Disallow: /manufacturer/details/COMPOSTAR
Disallow: /manufacturer/details/SIE
Disallow: /manufacturer/details/DIP16
Disallow: /manufacturer/details/HML
Disallow: /manufacturer/details/GIT
Disallow: /manufacturer/details/ESI
Disallow: /manufacturer/details/PARDUIT
Disallow: /manufacturer/details/ADR
Disallow: /manufacturer/details/ENE
Disallow: /manufacturer/details/MLG
Disallow: /manufacturer/details/COMMSCOPE
Disallow: /manufacturer/details/EVER
Disallow: /manufacturer/details/2B
Disallow: /manufacturer/details/NIP
Disallow: /manufacturer/details/HUAJING
Disallow: /manufacturer/details/IPS
Disallow: /manufacturer/details/FL
Disallow: /manufacturer/details/MIT
Disallow: /manufacturer/details/NSN
Disallow: /manufacturer/details/FUJIELECTRIC
Disallow: /manufacturer/details/SSN
Disallow: /manufacturer/details/MAT
Disallow: /manufacturer/details/GENNUM
Disallow: /manufacturer/details/AN
Disallow: /manufacturer/details/SAPS
Disallow: /manufacturer/details/OML
Disallow: /manufacturer/details/LSPS
Disallow: /manufacturer/details/DIGITAL%20VIEW
Disallow: /manufacturer/details/HSMC
Disallow: /manufacturer/details/TKD
Disallow: /manufacturer/details/HYEOPJIN
Disallow: /manufacturer/details/ANAM
Disallow: /manufacturer/details/SKN
Disallow: /manufacturer/details/INPQA
Disallow: /manufacturer/details/JAT
Disallow: /manufacturer/details/SILICONLABS
Disallow: /manufacturer/details/LSD
Disallow: /manufacturer/details/HYS
Disallow: /manufacturer/details/TE
Disallow: /manufacturer/details/KUAN%20HSI
Disallow: /manufacturer/details/ESC
Disallow: /manufacturer/details/SMG
Disallow: /manufacturer/details/TMS
Disallow: /manufacturer/details/SKA
Disallow: /manufacturer/details/MICROCIP
Disallow: /manufacturer/details/RX3
Disallow: /manufacturer/details/KED
Disallow: /manufacturer/details/KEN-TOP
Disallow: /manufacturer/details/KIA
Disallow: /manufacturer/details/WTJ
Disallow: /manufacturer/details/SANISK
Disallow: /manufacturer/details/SRC
Disallow: /manufacturer/details/KBR
Disallow: /manufacturer/details/TSV
Disallow: /manufacturer/details/MT
Disallow: /manufacturer/details/VR
Disallow: /manufacturer/details/ZZB
Disallow: /manufacturer/details/EMP
Disallow: /manufacturer/details/AIPRAX
Disallow: /product/parts/9801537
Disallow: /manufacturer/details/IL
Disallow: /manufacturer/details/KDS
Disallow: /product/parts/100319396
Disallow: /manufacturer/details/FREESCAL
Disallow: /manufacturer/details/HSL
Disallow: /product/parts/6920
Disallow: /manufacturer/details/ALLEN-BRADLEY
Disallow: /manufacturer/details/JOINSET
Disallow: /manufacturer/details/FXXC
Disallow: /manufacturer/details/CREATIVE
Disallow: /manufacturer/details/DAEBO
Disallow: /manufacturer/details/ADM
Disallow: /manufacturer/details/0B
Disallow: /manufacturer/details/AUKCORP
Disallow: /manufacturer/details/CHMCSTON
Disallow: /manufacturer/details/STY
Disallow: /manufacturer/details/CRYSTRL
Disallow: /manufacturer/details/PART
Disallow: /manufacturer/details/RENASASS
Disallow: /manufacturer/details/THE
Disallow: /manufacturer/details/SP
Disallow: /manufacturer/details/HKE
Disallow: /manufacturer/details/LL
Disallow: /manufacturer/details/SOD
Disallow: /manufacturer/details/CAPELLA
Disallow: /manufacturer/details/ALPHA&OMEGA
Disallow: /manufacturer/details/CR
Disallow: /manufacturer/details/SEN
Disallow: /manufacturer/details/AMI%20SEMICONDUCTOR
Disallow: /manufacturer/details/SNY
Disallow: /manufacturer/details/JF
Disallow: /manufacturer/details/CORERIVER
Disallow: /manufacturer/details/KEM
Disallow: /manufacturer/details/SL
Disallow: /manufacturer/details/LE
Disallow: /manufacturer/details/SNK
Disallow: /manufacturer/details/TW
Disallow: /manufacturer/details/LTK
Disallow: /manufacturer/details/SID
Disallow: /manufacturer/details/EVOX%20RIFA
Disallow: /manufacturer/details/COL
Disallow: /manufacturer/details/GIGADEVIC
Disallow: /manufacturer/details/TEC
Disallow: /manufacturer/details/HA
Disallow: /manufacturer/details/COSIN
Disallow: /manufacturer/details/CYNTE
Disallow: /manufacturer/details/COTCO
Disallow: /manufacturer/details/3U
Disallow: /manufacturer/details/CCE
Disallow: /manufacturer/details/3COM
Disallow: /manufacturer/details/LSILOGI
Disallow: /manufacturer/details/CHIPOEN
Disallow: /manufacturer/details/WACOM
Disallow: /manufacturer/details/SIX
Disallow: /manufacturer/details/PMI
Disallow: /manufacturer/details/SIW
Disallow: /manufacturer/details/OK%20INDUSTRIES
Disallow: /manufacturer/details/ASTRON
Disallow: /manufacturer/details/PSI
Disallow: /manufacturer/details/DAYI-ELEC
Disallow: /manufacturer/details/EVERLIGH
Disallow: /manufacturer/details/RTL
Disallow: /manufacturer/details/AUSTRIAMICROSYSTEMS%20AG
Disallow: /manufacturer/details/EAST
Disallow: /manufacturer/details/A1SEMI
Disallow: /manufacturer/details/IFM
Disallow: /manufacturer/details/MARK
Disallow: /manufacturer/details/AUTOLIV
Disallow: /manufacturer/details/TR
Disallow: /manufacturer/details/ADA
Disallow: /manufacturer/details/SICG
Disallow: /manufacturer/details/SMP
Disallow: /manufacturer/details/EMCT
Disallow: /manufacturer/details/CN
Disallow: /product/parts/100215369
Disallow: /manufacturer/details/BZD
Disallow: /manufacturer/details/ALCO
Disallow: /manufacturer/details/UCA
Disallow: /manufacturer/details/PI
Disallow: /manufacturer/details/MEGAWIN
Disallow: /manufacturer/details/PULS
Disallow: /manufacturer/details/HOSHIDEN
Disallow: /manufacturer/details/ELED
Disallow: /manufacturer/details/BAIRONG
Disallow: /manufacturer/details/EXCEL
Disallow: /manufacturer/details/MOSTYLE
Disallow: /manufacturer/details/ISA
Disallow: /manufacturer/details/CONTINENTAL%20INDUSTRIES
Disallow: /manufacturer/details/JNS-DZ
Disallow: /manufacturer/details/BELSTEWART
Disallow: /manufacturer/details/MOTO
Disallow: /manufacturer/details/DATE
Disallow: /manufacturer/details/PU
Disallow: /manufacturer/details/AMICA
Disallow: /manufacturer/details/MFG
Disallow: /manufacturer/details/VNCR
Disallow: /manufacturer/details/NU
Disallow: /manufacturer/details/WST
Disallow: /product/parts/410103
Disallow: /manufacturer/details/GH
Disallow: /manufacturer/details/PQI
Disallow: /manufacturer/details/WON
Disallow: /manufacturer/details/LST
Disallow: /product/parts/21851
Disallow: /manufacturer/details/GREEN
Disallow: /manufacturer/details/SUN
Disallow: /manufacturer/details/LGE
Disallow: /manufacturer/details/LINFINIT
Disallow: /manufacturer/details/UK
Disallow: /manufacturer/details/EIPIDA
Disallow: /manufacturer/details/HOL
Disallow: /manufacturer/details/SFT
Disallow: /manufacturer/details/HGHKE
Disallow: /product/cate/151
Disallow: /manufacturer/details/LS
Disallow: /manufacturer/details/ROHMPB
Disallow: /manufacturer/details/PANGSONIC
Disallow: /manufacturer/details/AEC
Disallow: /manufacturer/details/JUNYE
Disallow: /manufacturer/details/ACF
Disallow: /manufacturer/details/CHAHUA
Disallow: /manufacturer/details/VLI
Disallow: /manufacturer/details/ROCKCHIP
Disallow: /manufacturer/details/E-TEC
Disallow: /manufacturer/details/EB
Disallow: /manufacturer/details/BUS
Disallow: /manufacturer/details/ICC
Disallow: /manufacturer/details/MCH
Disallow: /manufacturer/details/MTT
Disallow: /manufacturer/details/PFS
Disallow: /manufacturer/details/RTH
Disallow: /manufacturer/details/NIS
Disallow: /manufacturer/details/NSF
Disallow: /manufacturer/details/K&L
Disallow: /manufacturer/details/ETI
Disallow: /manufacturer/details/MW
Disallow: /manufacturer/details/-
Disallow: /manufacturer/details/IARA
Disallow: /manufacturer/details/AKW
Disallow: /manufacturer/details/AZ
Disallow: /manufacturer/details/SDC
Disallow: /manufacturer/details/LEDDYNAMICS
Disallow: /manufacturer/details/BAI%20HONG
Disallow: /manufacturer/details/PA
Disallow: /manufacturer/details/ANTELEC
Disallow: /manufacturer/details/AGT
Disallow: /manufacturer/details/PER
Disallow: /manufacturer/details/LIS
Disallow: /product/mfg/TAKAMIZAWA
Disallow: /manufacturer/details/IPI
Disallow: /manufacturer/details/LM
Disallow: /manufacturer/details/AOLSZ
Disallow: /manufacturer/details/HII
Disallow: /manufacturer/details/HAM
Disallow: /manufacturer/details/ETC1
Disallow: /manufacturer/details/FORTECH
Disallow: /manufacturer/details/APW
Disallow: /manufacturer/details/ITF
Disallow: /manufacturer/details/B1
Disallow: /manufacturer/details/NIAS
Disallow: /manufacturer/details/DW
Disallow: /manufacturer/details/EW
Disallow: /manufacturer/details/SCANDISK
Disallow: /manufacturer/details/RSMTECH
Disallow: /manufacturer/details/FS
Disallow: /manufacturer/details/ITW-CHEM
Disallow: /manufacturer/details/ACER
Disallow: /manufacturer/details/KING
Disallow: /manufacturer/details/GPL
Disallow: /manufacturer/details/AZUREWAVE
Disallow: /manufacturer/details/CONWISE
Disallow: /manufacturer/details/XCV
Disallow: /manufacturer/details/REI
Disallow: /manufacturer/details/MSM
Disallow: /manufacturer/details/AVC
Disallow: /manufacturer/details/CXA
Disallow: /manufacturer/details/FPS
Disallow: /manufacturer/details/ULN
Disallow: /manufacturer/details/BYD
Disallow: /manufacturer/details/KFX
Disallow: /manufacturer/details/PLCC44
Disallow: /manufacturer/details/NORITAKE%20ITRON%20VFD
Disallow: /manufacturer/details/ECE
Disallow: /manufacturer/details/RAFI
Disallow: /manufacturer/details/MARKTECH
Disallow: /manufacturer/details/KAM
Disallow: /manufacturer/details/TLP
Disallow: /manufacturer/details/GTK
Disallow: /manufacturer/details/MOTOIOLA
Disallow: /manufacturer/details/ITTCANNON
Disallow: /manufacturer/details/DTBCOM
Disallow: /manufacturer/details/HC
Disallow: /manufacturer/details/KTC
Disallow: /manufacturer/details/DANIEL_WOODHEAD
Disallow: /manufacturer/details/DHC
Disallow: /manufacturer/details/FRAMATOME
Disallow: /manufacturer/details/TMT
Disallow: /manufacturer/details/RT
Disallow: /manufacturer/details/AMER
Disallow: /manufacturer/details/DFX
Disallow: /manufacturer/details/IPD
Disallow: /manufacturer/details/BUD
Disallow: /manufacturer/details/PLTS
Disallow: /manufacturer/details/GMT1F
Disallow: /manufacturer/details/SMS
Disallow: /manufacturer/details/LH
Disallow: /manufacturer/details/KAISE
Disallow: /manufacturer/details/HONHAI
Disallow: /manufacturer/details/REC
Disallow: /manufacturer/details/JHN
Disallow: /manufacturer/details/CMI
Disallow: /manufacturer/details/INE
Disallow: /manufacturer/details/MSV
Disallow: /manufacturer/details/ATF
Disallow: /manufacturer/details/TEKNDVUS
Disallow: /manufacturer/details/S+M
Disallow: /manufacturer/details/TA-I%20TECH
Disallow: /manufacturer/details/CSC
Disallow: /manufacturer/details/ELC
Disallow: /manufacturer/details/RTD
Disallow: /manufacturer/details/JXB
Disallow: /manufacturer/details/POWERSEM
Disallow: /manufacturer/details/KMP
Disallow: /manufacturer/details/CDS
Disallow: /manufacturer/details/EPX%20MICROWAVE
Disallow: /manufacturer/details/HST
Disallow: /manufacturer/details/ALTREA
Disallow: /manufacturer/details/KRS
Disallow: /manufacturer/details/CROUP-TEK
Disallow: /manufacturer/details/GROUP-T
Disallow: /manufacturer/details/JINHAI
Disallow: /manufacturer/details/VTM
Disallow: /manufacturer/details/GROUP-TECK
Disallow: /manufacturer/details/HEL
Disallow: /manufacturer/details/LGPHILIPSLCD
Disallow: /manufacturer/details/EPIGAP
Disallow: /manufacturer/details/ITA
Disallow: /manufacturer/details/YAMA
Disallow: /manufacturer/details/NEDI
Disallow: /manufacturer/details/APR
Disallow: /manufacturer/details/JLWORLD
Disallow: /manufacturer/details/GLIOXIN
Disallow: /manufacturer/details/GIGA%20DEVICE
Disallow: /manufacturer/details/DORDIC
Disallow: /manufacturer/details/TDTAIKO
Disallow: /manufacturer/details/HF
Disallow: /manufacturer/details/FGX
Disallow: /manufacturer/details/DESTINY
Disallow: /manufacturer/details/PRODIGIT
Disallow: /manufacturer/details/CHANG%20SUNG%20(H)
Disallow: /manufacturer/details/ICT
Disallow: /manufacturer/details/ETEK
Disallow: /manufacturer/details/INR
Disallow: /manufacturer/details/INTER
Disallow: /manufacturer/details/FUJIKURA
Disallow: /product/parts/65126907
Disallow: /manufacturer/details/BLCH
Disallow: /manufacturer/details/SLE
Disallow: /manufacturer/details/PTR
Disallow: /manufacturer/details/CONNOR%20WINFIELD
Disallow: /manufacturer/details/HOTCHIP
Disallow: /manufacturer/details/KET
Disallow: /manufacturer/details/HEDS
Disallow: /manufacturer/details/PMM
Disallow: /manufacturer/details/PACCOM
Disallow: /manufacturer/details/AUK%20LED
Disallow: /manufacturer/details/FDK%20BATTERIES%20(FORMERLY%20SANYO)
Disallow: /manufacturer/details/SAMW
Disallow: /manufacturer/details/PAN%20JIT
Disallow: /manufacturer/details/TMI
Disallow: /manufacturer/details/EBCHQ
Disallow: /manufacturer/details/CIR
Disallow: /manufacturer/details/A04402
Disallow: /manufacturer/details/HNS
Disallow: /manufacturer/details/DBLE
Disallow: /manufacturer/details/SANSUMG
Disallow: /manufacturer/details/OTI
Disallow: /manufacturer/details/FUJ
Disallow: /manufacturer/details/CE
Disallow: /manufacturer/details/DVE
Disallow: /manufacturer/details/HI
Disallow: /manufacturer/details/MST
Disallow: /manufacturer/details/HASC
Disallow: /manufacturer/details/STI
Disallow: /manufacturer/details/3L
Disallow: /manufacturer/details/DIODE%20LASER%20CONCEPTS
Disallow: /manufacturer/details/NETD
Disallow: /manufacturer/details/BARRY
Disallow: /manufacturer/details/MHS
Disallow: /manufacturer/details/DALL
Disallow: /manufacturer/details/MMI
Disallow: /manufacturer/details/JDI
Disallow: /manufacturer/details/ECC
Disallow: /manufacturer/details/KYC
Disallow: /manufacturer/details/ABR
Disallow: /manufacturer/details/IMLSMI
Disallow: /manufacturer/details/SEGA
Disallow: /manufacturer/details/QX
Disallow: /manufacturer/details/ALC
Disallow: /manufacturer/details/CHIPGOAL
Disallow: /manufacturer/details/STM
Disallow: /manufacturer/details/NGK
Disallow: /manufacturer/details/KOKURIKU
Disallow: /manufacturer/details/HONHAIPRECISIONINDCOLTD
Disallow: /manufacturer/details/PHL
Disallow: /manufacturer/details/LTL
Disallow: /manufacturer/details/MAGDOTCOMM
Disallow: /manufacturer/details/SB
Disallow: /manufacturer/details/PUL
Disallow: /manufacturer/details/CJT
Disallow: /manufacturer/details/TARNGYU
Disallow: /manufacturer/details/EUPHONLK
Disallow: /manufacturer/details/DN
Disallow: /manufacturer/details/ESPON
Disallow: /manufacturer/details/ZHJ
Disallow: /manufacturer/details/TRC
Disallow: /manufacturer/details/AC%20SSR
Disallow: /manufacturer/details/KAE
Disallow: /manufacturer/details/WEITREND
Disallow: /manufacturer/details/CERATE
Disallow: /manufacturer/details/COPPERGA
Disallow: /manufacturer/details/MOSDESIG
Disallow: /manufacturer/details/ITE
Disallow: /manufacturer/details/4P
Disallow: /manufacturer/details/ATT
Disallow: /manufacturer/details/RHNXP%20SE
Disallow: /manufacturer/details/CEPAG
Disallow: /manufacturer/details/GST
Disallow: /manufacturer/details/RTS
Disallow: /manufacturer/details/SCHNEIDERELECTRIC
Disallow: /manufacturer/details/KGB
Disallow: /manufacturer/details/CORTROL
Disallow: /manufacturer/details/STN
Disallow: /manufacturer/details/BRIGHT%20L
Disallow: /manufacturer/details/CSG
Disallow: /manufacturer/details/LDB
Disallow: /manufacturer/details/MK
Disallow: /manufacturer/details/GY
Disallow: /manufacturer/details/LKY
Disallow: /manufacturer/details/FRD
Disallow: /manufacturer/details/BROO
Disallow: /manufacturer/details/E20
Disallow: /manufacturer/details/LUCIX
Disallow: /manufacturer/details/AGERES
Disallow: /manufacturer/details/ICD
Disallow: /manufacturer/details/BRI
Disallow: /manufacturer/details/AGER
Disallow: /manufacturer/details/SOLIDLITE
Disallow: /manufacturer/details/AX
Disallow: /manufacturer/details/BSE
Disallow: /manufacturer/details/ANDATEK
Disallow: /manufacturer/details/CAL
Disallow: /manufacturer/details/BIZLINK
Disallow: /manufacturer/details/EXCEL%20CELL%20ELECTRONIC
Disallow: /manufacturer/details/HEI
Disallow: /manufacturer/details/FUNJIN
Disallow: /manufacturer/details/NVC
Disallow: /manufacturer/details/ECL
Disallow: /manufacturer/details/HYL
Disallow: /manufacturer/details/PERIPHERAES
Disallow: /manufacturer/details/RHO
Disallow: /manufacturer/details/13+OZ
Disallow: /manufacturer/details/E2O
Disallow: /manufacturer/details/M-TEK
Disallow: /manufacturer/details/PTR%20CONNEX
Disallow: /manufacturer/details/RMC
Disallow: /manufacturer/details/TNY
Disallow: /manufacturer/details/SJ
Disallow: /manufacturer/details/SOP
Disallow: /manufacturer/details/DINTEK
Disallow: /manufacturer/details/CHIPSBANK
Disallow: /manufacturer/details/L_3
Disallow: /manufacturer/details/KH
Disallow: /manufacturer/details/HLI
Disallow: /manufacturer/details/DLOGIXS
Disallow: /manufacturer/details/EC
Disallow: /manufacturer/details/TAG
Disallow: /manufacturer/details/JALCO
Disallow: /manufacturer/details/COMEXAT
Disallow: /manufacturer/details/IRW
Disallow: /manufacturer/details/TLM
Disallow: /manufacturer/details/CHIPSHIN
Disallow: /manufacturer/details/NSR
Disallow: /manufacturer/details/KS
Disallow: /manufacturer/details/TKS
Disallow: /manufacturer/details/STAUBLL
Disallow: /manufacturer/details/MICROMETRICS